00000001:02000400:2.0F:1789445609.098937:0:2961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg659-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789445626.386972:0:3188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg659-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1789445628.687222:0:3250:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 422 MB/s 00000001:01000000:2.0:1789445628.942143:0:3250:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 392 MB/s 00000001:01000000:2.0:1789445629.197249:0:3250:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2376 MB/s 00000020:02000000:2.0:1789445630.342004:0:3279:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_ge07ba0b 00000400:02000000:1.0F:1789445631.016544:0:3294:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.206.159@tcp [8/256/0/180] 00008000:02000000:0.0:1789445635.148934:0:3444:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789445683.168288:0:5245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg659-server.virtnet: executing load_modules_local 00000020:01000004:3.0F:1789445691.944974:0:5822:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789445691.945096:0:5822:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789445691.945252:0:5822:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005dfc7bda 00000080:02000400:3.0:1789445691.945263:0:5822:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789445691.965300:0:5822:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789445691.965314:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789445691.965360:0:5822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000bede8fe8) 00000020:00000080:3.0:1789445691.965383:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789445692.010862:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789445692.017654:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789445692.078821:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789445692.078870:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789445692.078892:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789445692.079497:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789445692.079525:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789445692.081118:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789445692.081133:0:5822:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789445692.081148:0:5822:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1b37c4d47255d8f 00000020:01000004:2.0:1789445692.081157:0:5822:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789445692.081162:0:5822:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789445692.081169:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005dfc7bda from MGS 00000020:01000004:2.0:1789445692.081173:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789445692.081199:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a784d5ac) 00000020:00000080:2.0:1789445692.081211:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789445692.081322:0:5822:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005dfc7bda from MGS, refs=2 00080000:01000000:2.0:1789445692.081327:0:5822:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789445692.081334:0:5822:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1b37c4d47255d9d 00000100:00100000:2.0:1789445692.081702:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789445692.082176:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789445692.082184:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789445692.083673:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789445692.083685:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789445692.084641:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789445692.084854:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789445692.084860:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789445692.086689:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789445692.086704:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789445692.087522:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789445692.087537:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789445692.096548:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445692.096557:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445692.096559:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445692.104470:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445692.104478:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445692.104480:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445692.106467:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789445692.120392:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789445692.356216:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3199 MB/s 00000001:01000000:3.0:1789445692.606253:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4387 MB/s 00000001:01000000:1.0:1789445692.856648:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 791 MB/s 00000001:01000000:1.0:1789445693.106186:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 675 MB/s 00080000:10000000:1.0:1789445693.117569:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1789445693.130804:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789445693.130821:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789445693.130823:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789445693.136589:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789445693.136706:0:5822:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789445693.136808:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789445693.137040:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789445693.137101:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789445693.137434:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789445693.137578:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789445693.137583:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789445693.139946:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789445693.139963:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789445693.140405:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789445693.140418:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789445693.141815:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789445693.141847:0:5822:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.159@tcp' 00000020:01000004:2.0:1789445693.141849:0:5822:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789445693.141898:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.159@tcp (typ=mgc) 00000020:00000080:2.0:1789445693.141909:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.159@tcp (00000000c48335e2) 00000020:00000080:2.0:1789445693.141930:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789445693.142034:0:5822:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a7d5d2a0@MGC192.168.206.159@tcp: add connection 192.168.206.159@tcp at head 00000100:00080000:0.0:1789445693.142373:0:5837:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:2.0:1789445693.142484:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.159@tcp-0 is initialized 00000040:01000000:2.0:1789445693.142490:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.159@tcp ctxt 1 is initialized 00010000:00010000:2.0:1789445693.146682:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789445693.146734:0:5838:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789445693.146797:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.159@tcp (uuid a74a4946-2de5-4f94-9e7c-96ec5d765e2c) 00000020:00000080:2.0:1789445693.146828:0:5822:0:(genops.c:1384:class_connect()) connect: client a74a4946-2de5-4f94-9e7c-96ec5d765e2c, cookie 0xc1b37c4d47255dab 00000100:00080000:2.0:1789445693.146845:0:5822:0:(import.c:545:import_select_connection()) MGC192.168.206.159@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789445693.146857:0:5822:0:(import.c:666:import_select_connection()) MGC192.168.206.159@tcp: import 00000000a7d5d2a0 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:2.0:1789445693.147522:0:5822:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000076ab9bcc x1876369741971584/t0(0) o250->MGC192.168.206.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789445693.148650:0:5822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a74a4946-2de5-4f94-9e7c-96ec5d765e2c->MGS 00000020:01000004:2.0:1789445693.148673:0:5822:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789445693.148682:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789445693.148701:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000df1d8f31) 00000020:00000080:2.0:1789445693.148723:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789445693.150927:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000076ab9bcc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3309:1876369741971584:0@lo:250: 00000100:00100000:0.0:1789445693.150991:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445693.151102:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741971584 00000100:00100000:0.0:1789445693.151111:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741971584 00000100:00100000:0.0:1789445693.151160:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789445693.151167:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009ed1e6b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1876369741971584:12345-0@lo:250: 00010000:00080000:0.0:1789445693.151822:0:5834:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from a74a4946-2de5-4f94-9e7c-96ec5d765e2c@0@lo t0 exp 0000000000000000 cur 131 last 0 00000020:00000080:0.0:1789445693.151858:0:5834:0:(genops.c:1384:class_connect()) connect: client a74a4946-2de5-4f94-9e7c-96ec5d765e2c, cookie 0xc1b37c4d47255db9 00000100:00080000:0.0:1789445693.152022:0:5834:0:(import.c:65:import_set_state_nolock()) 00000000f2aca3e5 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789445693.152118:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009ed1e6b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:3309:x1876369741971584:12345-0@lo:250: Request processed in 950us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445693.152126:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789445693.152185:0:3309:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.159@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789445693.152194:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.159@tcp: connect to target with instance 0 00000100:00080000:0.0:1789445693.152293:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.159@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789445693.152299:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789445693.152302:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000a7d5d2a0 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789445693.152305:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789445693.152316:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789445693.152321:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000076ab9bcc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3309:1876369741971584:0@lo:250: 00000100:00100000:3.0:1789445693.179117:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789445693.179485:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789445693.179492:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789445693.189340:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789445693.189362:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789445693.192981:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789445693.193028:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789445693.194718:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789445693.195130:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789445693.195137:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789445693.196352:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789445693.196366:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789445693.270686:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789445693.270883:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789445693.270889:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789445693.278537:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789445693.278557:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789445693.283128:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789445693.284373:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789445693.284382:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789445693.285833:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789445693.285845:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789445693.289694:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789445693.290020:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789445693.290026:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789445693.291684:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789445693.291695:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789445693.301519:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789445693.301693:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789445693.301699:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789445693.302289:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789445693.302296:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789445693.354752:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789445693.361415:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789445693.361431:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789445693.364038:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789445693.364076:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789445693.367307:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789445693.367322:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789445693.370023:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789445693.371729:0:5822:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789445693.371739:0:5822:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.159@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789445693.371865:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.159@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789445693.371902:0:5822:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.159@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789445693.371906:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789445693.371908:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789445693.371909:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789445693.371911:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789445693.371912:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789445693.371913:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789445693.371914:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789445693.371916:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789445693.371917:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789445693.371919:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789445693.371920:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789445693.371921:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789445693.371923:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789445693.371930:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789445693.371931:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789445693.371932:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789445693.371933:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789445693.371934:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789445693.371935:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789445693.371936:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789445693.371937:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789445693.371938:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789445693.371938:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789445693.371939:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789445693.371940:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789445693.371975:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789445693.371992:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb86e894 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741971712:0@lo:253: 00000100:00100000:0.0:1789445693.372780:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445693.372877:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cc01b78f going to sleep for 11 seconds 00000100:00100000:0.0:1789445693.377009:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741971712 00000100:00100000:0.0:1789445693.377025:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741971712 00000100:00100000:2.0:1789445693.377699:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789445693.377709:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001bb31849 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:5822:x1876369741971712:12345-0@lo:253: 20000000:01000000:2.0:1789445693.377773:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789445693.377777:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789445693.378037:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789445693.378138:0:5834:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789445693.378417:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789445693.379469:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789445693.379692:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789445693.379697:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789445693.379702:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789445693.379705:0:5834:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789445693.379720:0:5834:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789445693.379894:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789445693.380420:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789445693.380434:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789445693.380481:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789445693.380527:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789445693.380562:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789445693.380666:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789445693.380676:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789445693.380720:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789445693.380728:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789445693.380760:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789445693.380767:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789445693.380799:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789445693.380845:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789445693.380878:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789445693.380883:0:5834:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789445693.380897:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789445693.381127:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789445693.381138:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789445693.381171:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789445693.381288:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789445693.381341:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789445693.381361:0:5834:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789445693.381440:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789445693.381449:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789445693.381491:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789445693.381525:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789445693.381557:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789445693.381568:0:5834:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789445693.381661:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789445693.381672:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789445693.381705:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789445693.381740:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789445693.381889:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789445693.381934:0:5834:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789445693.381941:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789445693.382589:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789445693.382839:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789445693.382860:0:5834:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.159@tcp for mdt 20000000:01000000:2.0:1789445693.382862:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.159@tcp (null) (null) (null) 00000040:00080000:2.0:1789445693.382897:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789445693.382905:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789445693.382935:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789445693.382943:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.159@tcp (null) (null) 00000040:00080000:2.0:1789445693.382989:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789445693.382999:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789445693.383031:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789445693.383309:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789445693.383376:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789445693.383379:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789445693.383385:0:5834:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789445693.383391:0:5834:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789445693.383749:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1789445693.383903:0:5834:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1789445693.402749:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789445693.402802:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1789445693.402874:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1789445693.402894:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789445693.402896:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789445693.402900:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789445693.402912:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789445693.402914:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789445693.402956:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789445693.402958:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789445693.409177:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1789445693.409537:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1789445693.409584:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1789445693.409663:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:2.0:1789445693.409678:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789445693.409680:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789445693.410692:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789445693.411078:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789445693.411126:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789445693.411160:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1789445693.411174:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789445693.411177:0:5834:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1789445693.411184:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789445693.411333:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008d40ef95/0xc1b37c4d47255dc0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445693.411349:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008d40ef95/0xc1b37c4d47255dc0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445693.411358:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008d40ef95/0xc1b37c4d47255dc0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445693.411363:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008d40ef95/0xc1b37c4d47255dc0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445693.411368:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008d40ef95/0xc1b37c4d47255dc0 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445693.411374:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008d40ef95/0xc1b37c4d47255dc0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445693.411379:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008d40ef95 already unused, calling callback (00000000e61a8462) 00010000:00010000:3.0:1789445693.411382:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008d40ef95/0xc1b37c4d47255dc0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445693.411388:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008d40ef95/0xc1b37c4d47255dc0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445693.411413:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008d40ef95/0xc1b37c4d47255dc0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445693.411420:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008d40ef95/0xc1b37c4d47255dc0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445693.411426:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008d40ef95/0xc1b37c4d47255dc0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789445693.411520:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789445693.641255:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001bb31849 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:5822:x1876369741971712:12345-0@lo:253: Request processed in 263540us (268469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445693.641272:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789445693.641667:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb86e894 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741971712:0@lo:253: 10000000:01000000:2.0:1789445693.641684:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789445693.641687:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789445693.641689:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789445693.641691:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789445693.641692:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789445693.641693:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789445693.641694:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789445693.641695:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789445693.641697:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789445693.641698:0:5822:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789445693.641700:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789445693.641701:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789445693.641721:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005dfc7bda from lustre-MDT0000 10000000:01000000:2.0:1789445693.641745:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789445693.641748:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789445693.641753:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9afea4f94d40 10000000:01000000:2.0:1789445693.641757:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789445693.641765:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9afea4f94d40 from 1 10000000:01000000:2.0:1789445693.641768:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789445693.641805:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: 000000001d139f6f/0xc1b37c4d47255dc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445693.641816:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: 000000001d139f6f/0xc1b37c4d47255dc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445693.641825:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: 000000001d139f6f/0xc1b37c4d47255dc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445693.641857:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d4b34b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741971840:0@lo:101: 00000100:00100000:2.0:1789445693.641932:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445693.641996:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000006cf6a6 going to sleep for 11 seconds 00000100:00100000:0.0:1789445693.642611:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741971840 00000100:00100000:0.0:1789445693.642620:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741971840 00000100:00100000:0.0:1789445693.642668:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789445693.642677:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f2679daa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:5822:x1876369741971840:12345-0@lo:101: 00010000:00010000:0.0:1789445693.642690:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445693.642712:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003b56273e/0xc1b37c4d47255dce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255dc7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445693.642737:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b56273e/0xc1b37c4d47255dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255dc7 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445693.642747:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003b56273e/0xc1b37c4d47255dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255dc7 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445693.642755:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003b56273e, rc 0) 00000100:00100000:0.0:1789445693.642796:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f2679daa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+6:5822:x1876369741971840:12345-0@lo:101: Request processed in 120us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445693.642805:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789445693.642915:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d4b34b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741971840:0@lo:101: 00010000:00010000:2.0:1789445693.642927:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: 000000001d139f6f/0xc1b37c4d47255dc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255dce expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445693.642935:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: 000000001d139f6f/0xc1b37c4d47255dc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255dce expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445693.642999:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d4b34b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741971968:0@lo:501: 00000100:00100000:2.0:1789445693.643024:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445693.643097:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000006cf6a6 going to sleep for 11 seconds 00000100:00100000:0.0:1789445693.644584:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741971968 00000100:00100000:0.0:1789445693.644596:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741971968 00000100:00100000:0.0:1789445693.644724:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789445693.644733:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000303b7673 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+6:5822:x1876369741971968:12345-0@lo:501: 00000100:00100000:0.0:1789445693.645005:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000303b7673 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+6:5822:x1876369741971968:12345-0@lo:501: Request processed in 274us (1980us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789445693.645013:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789445693.645096:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d4b34b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741971968:0@lo:501: 10000000:01000000:2.0:1789445693.645129:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789445693.645151:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: 000000001d139f6f/0xc1b37c4d47255dc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255dce expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445693.645161:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: 000000001d139f6f/0xc1b37c4d47255dc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255dce expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445693.645171:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9afe9d560800 10000000:01000000:2.0:1789445693.645177:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789445693.645181:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9afe9d560800 10000000:01000000:2.0:1789445693.645184:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789445693.645188:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9afe9d560800 from 1 10000000:01000000:2.0:1789445693.645198:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789445693.645248:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: 00000000d2398788/0xc1b37c4d47255dd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445693.645256:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: 00000000d2398788/0xc1b37c4d47255dd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445693.645264:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: 00000000d2398788/0xc1b37c4d47255dd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445693.645290:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d4b34b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741972096:0@lo:101: 00000100:00100000:2.0:1789445693.645321:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445693.652949:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000006cf6a6 going to sleep for 11 seconds 00000100:00100000:3.0:1789445693.654554:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741972096 00000100:00100000:3.0:1789445693.654569:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741972096 00000100:00100000:3.0:1789445693.654627:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789445693.654634:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000974c4e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+6:5822:x1876369741972096:12345-0@lo:101: 00010000:00010000:3.0:1789445693.655106:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445693.655127:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008d40ef95/0xc1b37c4d47255ddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255dd5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445693.655156:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008d40ef95/0xc1b37c4d47255ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255dd5 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445693.655166:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008d40ef95/0xc1b37c4d47255ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255dd5 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445693.655174:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008d40ef95, rc 0) 00000100:00100000:3.0:1789445693.655295:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000974c4e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+7:5822:x1876369741972096:12345-0@lo:101: Request processed in 661us (9973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445693.655303:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789445693.656572:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d4b34b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741972096:0@lo:101: 00010000:00010000:2.0:1789445693.656596:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: 00000000d2398788/0xc1b37c4d47255dd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255ddc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445693.656606:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: 00000000d2398788/0xc1b37c4d47255dd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255ddc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445693.656625:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789445693.656636:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: 00000000d2398788/0xc1b37c4d47255dd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255ddc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445693.656642:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: 00000000d2398788/0xc1b37c4d47255dd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255ddc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445693.656651:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789445693.656658:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789445693.656665:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9afe9d560800 10000000:01000000:2.0:1789445693.656680:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789445693.656685:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789445693.656687:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789445693.656715:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: 00000000b9652827/0xc1b37c4d47255de3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445693.656721:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: 00000000b9652827/0xc1b37c4d47255de3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445693.656728:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: 00000000b9652827/0xc1b37c4d47255de3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445693.656745:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d4b34b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741972224:0@lo:101: 00000100:00100000:2.0:1789445693.656795:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445693.656827:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000006cf6a6 going to sleep for 11 seconds 00000100:00100000:3.0:1789445693.656992:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741972224 00000100:00100000:3.0:1789445693.657006:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741972224 00000100:00100000:3.0:1789445693.657040:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789445693.657061:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000042ab2e83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+7:5822:x1876369741972224:12345-0@lo:101: 00010000:00010000:3.0:1789445693.657071:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445693.657080:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000036bd23dd/0xc1b37c4d47255dea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255de3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445693.657112:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000036bd23dd/0xc1b37c4d47255dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255de3 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445693.657120:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000036bd23dd/0xc1b37c4d47255dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255de3 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445693.657129:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000036bd23dd, rc 0) 00000100:00100000:3.0:1789445693.657164:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000042ab2e83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+8:5822:x1876369741972224:12345-0@lo:101: Request processed in 104us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445693.657170:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789445693.658406:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d4b34b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741972224:0@lo:101: 00010000:00010000:2.0:1789445693.658440:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: 00000000b9652827/0xc1b37c4d47255de3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255dea expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445693.658451:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: 00000000b9652827/0xc1b37c4d47255de3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255dea expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445693.658519:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d4b34b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741972352:0@lo:501: 00000100:00100000:2.0:1789445693.658556:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445693.658579:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000006cf6a6 going to sleep for 11 seconds 00000100:00100000:3.0:1789445693.658789:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741972352 00000100:00100000:3.0:1789445693.658795:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741972352 00000100:00100000:3.0:1789445693.658824:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789445693.658831:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000303676ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+8:5822:x1876369741972352:12345-0@lo:501: 00000100:00100000:3.0:1789445693.659105:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000303676ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+9:5822:x1876369741972352:12345-0@lo:501: Request processed in 274us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445693.659114:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789445693.659198:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d4b34b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741972352:0@lo:501: 00000100:00100000:2.0:1789445693.659227:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d4b34b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741972480:0@lo:503: 00000100:00100000:2.0:1789445693.659263:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445693.659307:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000006cf6a6 going to sleep for 11 seconds 00000100:00100000:3.0:1789445693.659359:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741972480 00000100:00100000:3.0:1789445693.659364:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741972480 00000100:00100000:3.0:1789445693.659380:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789445693.659385:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000007def60c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+9:5822:x1876369741972480:12345-0@lo:503: 00000100:00100000:3.0:1789445693.659538:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000007def60c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+9:5822:x1876369741972480:12345-0@lo:503: Request processed in 152us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445693.659553:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789445693.659692:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d4b34b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741972480:0@lo:503: 00000100:00100000:1.0:1789445693.666727:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af7822bb pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5863:1876369741972608:0@lo:502: 00000100:00100000:1.0:1789445693.666840:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445693.666905:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741972608 00000100:00100000:1.0:1789445693.666914:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741972608 00000100:00100000:1.0:1789445693.667076:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789445693.667087:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005d138eef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+9:5863:x1876369741972608:12345-0@lo:502: 00000100:00100000:1.0:1789445693.667462:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005d138eef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+9:5863:x1876369741972608:12345-0@lo:502: Request processed in 376us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445693.667472:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789445693.667646:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set 00000000184dca66 going to sleep for 11 seconds 00000100:00100000:1.0:1789445693.667674:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af7822bb pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5863:1876369741972608:0@lo:502: 00000020:01000000:1.0:1789445693.667710:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789445693.667723:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445693.667731:0:5863:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789445693.667738:0:5863:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789445693.667741:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789445693.667765:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000002d5ebc2f) 00000020:00000080:1.0:1789445693.667788:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789445693.667795:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789445693.667935:0:5863:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789445693.667943:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1b37c4d47255df8 00000020:00000080:1.0:1789445693.668233:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789445693.668239:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445693.668242:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445693.668244:0:5863:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789445693.668247:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789445693.668250:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445693.668251:0:5863:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789445693.668254:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789445693.668260:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000ad86e320) 00000020:00000080:1.0:1789445693.668270:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789445693.668274:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789445693.668276:0:5863:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789445693.668289:0:5863:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789445693.668298:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789445693.668349:0:5863:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005dfc7bda from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789445693.668368:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000008e899ba2) 00000020:00000080:1.0:1789445693.668593:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789445693.668656:0:5863:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789445693.668662:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1b37c4d47255e0d 00000020:00000080:1.0:1789445693.668763:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789445693.668769:0:5863:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789445693.668774:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc1b37c4d47255e14 00080000:01000000:1.0:1789445693.668779:0:5863:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789445693.668782:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1b37c4d47255e1b 00080000:10000000:1.0:1789445693.669993:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1789445693.672450:0:5863:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1789445693.686599:0:5863:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789445693.831523:0:5863:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789445693.832113:0:5863:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789445693.836351:0:5863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789445693.837509:0:5863:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789445693.928039:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000189f91b0) 00000020:00000080:0.0:1789445693.928102:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789445693.928197:0:5863:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789445693.928205:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1b37c4d47255e29 00000020:00000080:0.0:1789445693.933199:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789445693.938849:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789445694.042496:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789445694.132738:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00010000:00010000:1.0:1789445694.170732:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1789445694.227340:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789445694.311261:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789445694.356770:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1789445694.411516:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc1b37c4d47255e30 00000020:00000080:1.0:1789445694.411979:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789445694.411993:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445694.412000:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445694.412003:0:5863:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789445694.412006:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789445694.412013:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445694.412014:0:5863:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789445694.412019:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789445694.412239:0:5863:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789445694.412324:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445694.412329:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445694.412331:0:5863:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789445694.412335:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789445694.412339:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445694.412341:0:5863:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789445694.412345:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789445694.412347:0:5863:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789445694.412477:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af7822bb pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5863:1876369741972736:0@lo:502: 00000100:00100000:1.0:1789445694.412577:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445694.412770:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set 0000000062461acc going to sleep for 11 seconds 00000100:00100000:0.0:1789445694.412907:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741972736 00000100:00100000:0.0:1789445694.412919:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741972736 00000100:00100000:0.0:1789445694.413020:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789445694.413041:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ebc1e0fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+9:5863:x1876369741972736:12345-0@lo:502: 00000100:00100000:0.0:1789445694.413974:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ebc1e0fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+9:5863:x1876369741972736:12345-0@lo:502: Request processed in 932us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445694.413985:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789445694.414194:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af7822bb pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5863:1876369741972736:0@lo:502: 00000020:01000000:3.0:1789445694.414231:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789445694.414239:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445694.414241:0:5863:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789445694.414246:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789445694.414750:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789445694.414775:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789445694.414822:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: 00000000b9652827/0xc1b37c4d47255de3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255dea expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.414834:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: 00000000b9652827/0xc1b37c4d47255de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255dea expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445694.414842:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afe9d560800 from 1 10000000:01000000:2.0:1789445694.414845:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789445694.414882:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: 00000000e20a8014/0xc1b37c4d47255e37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.414890:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: 00000000e20a8014/0xc1b37c4d47255e37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.414900:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: 00000000e20a8014/0xc1b37c4d47255e37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445694.414919:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d4b34b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741972864:0@lo:101: 00000100:00100000:2.0:1789445694.414967:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445694.415004:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000900cb5b4 going to sleep for 11 seconds 00000100:00100000:1.0:1789445694.415066:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741972864 00000100:00100000:1.0:1789445694.415073:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741972864 00000100:00100000:1.0:1789445694.415126:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789445694.415134:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a3f95591 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+9:5822:x1876369741972864:12345-0@lo:101: 00010000:00010000:1.0:1789445694.415148:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445694.415164:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006978239d/0xc1b37c4d47255e3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255e37 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445694.415206:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006978239d/0xc1b37c4d47255e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255e37 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445694.415218:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006978239d/0xc1b37c4d47255e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255e37 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445694.415228:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006978239d, rc 0) 00000100:00100000:1.0:1789445694.415289:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a3f95591 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+10:5822:x1876369741972864:12345-0@lo:101: Request processed in 156us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445694.415295:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789445694.415372:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d4b34b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741972864:0@lo:101: 00010000:00010000:2.0:1789445694.415394:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: 00000000e20a8014/0xc1b37c4d47255e37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255e3e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.415413:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: 00000000e20a8014/0xc1b37c4d47255e37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255e3e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445694.416094:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d4b34b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741972992:0@lo:256: 00000100:00100000:2.0:1789445694.416143:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445694.416180:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000900cb5b4 going to sleep for 11 seconds 00000100:00100000:1.0:1789445694.416389:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741972992 00000100:00100000:1.0:1789445694.416397:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741972992 00000100:00100000:1.0:1789445694.416448:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789445694.416456:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000082f0fe6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+10:5822:x1876369741972992:12345-0@lo:256: 20000000:01000000:1.0:1789445694.416475:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789445694.416481:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789445694.416558:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000082f0fe6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+10:5822:x1876369741972992:12345-0@lo:256: Request processed in 104us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445694.416566:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789445694.416602:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d4b34b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741972992:0@lo:256: 10000000:01000000:1.0:1789445694.419293:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789445694.419371:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: 00000000e20a8014/0xc1b37c4d47255e37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255e3e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445694.419397:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: 00000000e20a8014/0xc1b37c4d47255e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255e3e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445694.419426:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afe9d560800 from 1 10000000:01000000:1.0:1789445694.419428:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789445694.419474:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: 00000000c2046527/0xc1b37c4d47255e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445694.419481:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: 00000000c2046527/0xc1b37c4d47255e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445694.419491:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: 00000000c2046527/0xc1b37c4d47255e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445694.419515:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063366d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741973120:0@lo:101: 00000100:00100000:1.0:1789445694.419590:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445694.419658:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741973120 00000100:00100000:0.0:1789445694.419668:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741973120 00000100:00100000:1.0:1789445694.419703:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000009ba74b41 going to sleep for 11 seconds 00000100:00100000:0.0:1789445694.419726:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789445694.419735:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003fb104f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+10:5822:x1876369741973120:12345-0@lo:101: 00010000:00010000:0.0:1789445694.419750:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445694.419765:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006a95884b/0xc1b37c4d47255e4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255e45 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445694.419801:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006a95884b/0xc1b37c4d47255e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255e45 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445694.419813:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006a95884b/0xc1b37c4d47255e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255e45 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445694.419823:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006a95884b, rc 0) 00000100:00100000:0.0:1789445694.419874:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003fb104f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:5822:x1876369741973120:12345-0@lo:101: Request processed in 141us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445694.419917:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063366d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741973120:0@lo:101: 00010000:00010000:1.0:1789445694.419931:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: 00000000c2046527/0xc1b37c4d47255e45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255e4c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445694.419940:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: 00000000c2046527/0xc1b37c4d47255e45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255e4c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445694.419994:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063366d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741973248:0@lo:501: 00000100:00100000:1.0:1789445694.420018:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445694.420147:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000009ba74b41 going to sleep for 11 seconds 00000100:00100000:2.0:1789445694.420233:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741973248 00000100:00100000:2.0:1789445694.420237:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741973248 00000100:00100000:2.0:1789445694.420310:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789445694.420318:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000004b90cab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5822:x1876369741973248:12345-0@lo:501: 00000100:00100000:0.0:1789445694.420403:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789445694.421140:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000004b90cab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:5822:x1876369741973248:12345-0@lo:501: Request processed in 822us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445694.421149:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789445694.421298:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063366d4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741973248:0@lo:501: 00000100:00100000:3.0:1789445694.421358:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ce16d64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741973376:0@lo:503: 00000100:00100000:3.0:1789445694.421464:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445694.421558:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ddb00031 going to sleep for 11 seconds 00000100:00100000:1.0:1789445694.421628:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741973376 00000100:00100000:1.0:1789445694.421636:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741973376 00000100:00100000:1.0:1789445694.421670:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789445694.421677:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f241325f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:5822:x1876369741973376:12345-0@lo:503: 00000040:00080000:1.0:1789445694.421729:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789445694.421775:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f241325f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:5822:x1876369741973376:12345-0@lo:503: Request processed in 99us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445694.421782:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789445694.421920:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ce16d64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741973376:0@lo:503: 00000040:00080000:0.0:1789445694.423470:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1789445694.423720:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789445694.423746:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789445694.423771:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: 00000000c2046527/0xc1b37c4d47255e45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255e4c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445694.423784:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: 00000000c2046527/0xc1b37c4d47255e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255e4c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789445694.423853:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789445694.423855:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9afe9d560800 10000000:01000000:3.0:1789445694.423858:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9afe9d560800 10000000:01000000:3.0:1789445694.423863:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789445694.423869:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afe9d560800 from 1 10000000:01000000:3.0:1789445694.423872:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789445694.423912:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: 000000001a69ee5c/0xc1b37c4d47255e53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445694.423920:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: 000000001a69ee5c/0xc1b37c4d47255e53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445694.423931:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: 000000001a69ee5c/0xc1b37c4d47255e53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445694.423952:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ce16d64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741973504:0@lo:101: 00000100:00100000:3.0:1789445694.424015:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445694.424096:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a5ee16f going to sleep for 11 seconds 00000100:00100000:2.0:1789445694.424205:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741973504 00000100:00100000:2.0:1789445694.424214:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741973504 00000100:00100000:2.0:1789445694.424266:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789445694.424283:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fef3258b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:5822:x1876369741973504:12345-0@lo:101: 00010000:00010000:2.0:1789445694.424298:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445694.424314:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007eb03397/0xc1b37c4d47255e5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255e53 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.424341:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007eb03397/0xc1b37c4d47255e5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255e53 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.424352:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007eb03397/0xc1b37c4d47255e5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255e53 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.424386:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007eb03397, rc 0) 00000100:00100000:2.0:1789445694.424426:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fef3258b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5822:x1876369741973504:12345-0@lo:101: Request processed in 153us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445694.424432:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789445694.424563:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ce16d64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741973504:0@lo:101: 00010000:00010000:3.0:1789445694.424576:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: 000000001a69ee5c/0xc1b37c4d47255e53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255e5a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445694.424585:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: 000000001a69ee5c/0xc1b37c4d47255e53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255e5a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445694.424702:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ce16d64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741973632:0@lo:501: 00000100:00100000:3.0:1789445694.424729:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445694.424763:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741973632 00000100:00100000:3.0:1789445694.424767:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741973632 00000100:00100000:3.0:1789445694.424797:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789445694.424804:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f8164f10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5822:x1876369741973632:12345-0@lo:501: 00000100:00100000:3.0:1789445694.425163:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f8164f10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5822:x1876369741973632:12345-0@lo:501: Request processed in 359us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445694.425170:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789445694.425199:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a5ee16f going to sleep for 11 seconds 00000100:00100000:3.0:1789445694.425210:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ce16d64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741973632:0@lo:501: 00000100:00100000:3.0:1789445694.425237:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ce16d64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741973760:0@lo:503: 00000100:00100000:3.0:1789445694.425286:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445694.425308:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741973760 00000100:00100000:3.0:1789445694.425312:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741973760 00000100:00100000:3.0:1789445694.425333:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789445694.425338:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000abec6c0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5822:x1876369741973760:12345-0@lo:503: 00000100:00100000:3.0:1789445694.425839:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000abec6c0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5822:x1876369741973760:12345-0@lo:503: Request processed in 499us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445694.425847:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789445694.425881:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a5ee16f going to sleep for 11 seconds 00000100:00100000:3.0:1789445694.425893:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ce16d64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741973760:0@lo:503: 00000100:00100000:2.0:1789445694.426724:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e950426d pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5868:1876369741973888:0@lo:502: 00000100:00100000:2.0:1789445694.426775:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445694.426838:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 000000004be0f510 going to sleep for 11 seconds 00000100:00100000:3.0:1789445694.426871:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741973888 00000100:00100000:3.0:1789445694.426878:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741973888 00000100:00100000:3.0:1789445694.426946:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789445694.426953:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000028b4e981 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5868:x1876369741973888:12345-0@lo:502: 00000100:00100000:3.0:1789445694.427412:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000028b4e981 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5868:x1876369741973888:12345-0@lo:502: Request processed in 458us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445694.427429:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789445694.427696:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e950426d pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5868:1876369741973888:0@lo:502: 00000020:01000004:3.0:1789445694.427761:0:5868:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789445694.427779:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000008087cee5) 00000020:00000080:3.0:1789445694.427799:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789445694.427896:0:5868:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005dfc7bda from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789445694.427900:0:5868:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005dfc7bda from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789445694.427903:0:5868:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005dfc7bda 4 00010000:00080000:3.0:1789445694.427932:0:5868:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000770df54d@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.159@tcp at head 00010000:00010000:2.0:1789445694.431030:0:5868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789445694.431566:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789445694.431695:0:5868:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789445694.431733:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc1b37c4d47255e68 00000100:00080000:2.0:1789445694.431746:0:5868:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789445694.431758:0:5868:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000770df54d using connection 192.168.206.159@tcp/0@lo 00000100:00100000:2.0:1789445694.431803:0:5868:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002885a646 x1876369741974016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789445694.431836:0:5868:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789445694.432156:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002885a646 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876369741974016:0@lo:38: 00000100:00100000:1.0:1789445694.432239:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445694.432446:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098a84655 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5868:1876369741974144:0@lo:502: 00000100:00100000:1.0:1789445694.432503:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445694.432532:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741974144 00000100:00100000:1.0:1789445694.432539:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741974144 00000100:00100000:1.0:1789445694.432585:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789445694.432595:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003ac0c302 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5868:x1876369741974144:12345-0@lo:502: 00000100:00100000:1.0:1789445694.432969:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003ac0c302 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5868:x1876369741974144:12345-0@lo:502: Request processed in 374us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445694.432977:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789445694.433349:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 000000004e65f252 going to sleep for 11 seconds 00000100:00100000:1.0:1789445694.433432:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098a84655 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5868:1876369741974144:0@lo:502: 00000040:00080000:1.0:1789445694.433466:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:2.0:1789445694.433676:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741974016 00000100:00100000:2.0:1789445694.433683:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741974016 00000100:00100000:2.0:1789445694.433718:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789445694.433723:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a9194d44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876369741974016:12345-0@lo:38: 00000100:00100000:2.0:1789445694.433776:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a9194d44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876369741974016:12345-0@lo:38: Request processed in 52us (1538us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789445694.433783:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789445694.433904:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789445694.433912:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000770df54d lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789445694.433916:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789445694.433919:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002885a646 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876369741974016:0@lo:38: 00000020:01000000:0.0:1789445694.436327:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789445694.436367:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789445694.437015:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: 000000001a69ee5c/0xc1b37c4d47255e53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255e5a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445694.437032:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: 000000001a69ee5c/0xc1b37c4d47255e53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255e5a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789445694.438515:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789445694.438520:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789445694.438522:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789445694.438524:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789445694.438530:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789445694.438533:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789445694.438535:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789445694.438536:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789445694.438538:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789445694.438540:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789445694.438542:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789445694.438543:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789445694.438548:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1789445694.438551:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789445694.438552:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789445694.438554:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789445694.438555:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789445694.438556:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789445694.438557:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789445694.438558:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789445694.438559:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789445694.438560:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789445694.438561:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789445694.438562:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789445694.438563:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789445694.438641:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789445694.438664:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098a84655 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741974272:0@lo:253: 00000100:00100000:1.0:1789445694.438752:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445694.438944:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000004e65f252 going to sleep for 11 seconds 00000100:00100000:3.0:1789445694.439092:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741974272 00000100:00100000:3.0:1789445694.439103:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741974272 00000100:00100000:1.0:1789445694.439251:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789445694.439262:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fca05b27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5822:x1876369741974272:12345-0@lo:253: 20000000:01000000:1.0:1789445694.439327:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789445694.439344:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789445694.495007:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789445694.495032:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789445694.495128:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789445694.495134:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789445694.495159:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000019d9b1b6/0xc1b37c4d47255e6f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445694.495183:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006978239d/0xc1b37c4d47255e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255e37 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445694.495191:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000019d9b1b6/0xc1b37c4d47255e6f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445694.495240:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006978239d/0xc1b37c4d47255e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255e37 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445694.495255:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006978239d/0xc1b37c4d47255e3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255e37 expref: 12 pid: 5836 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445694.495271:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000699a20fa pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876369741974400:0@lo:104: 00000100:00100000:0.0:1789445694.495360:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445694.495438:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set 000000006278a8ad going to sleep for 11 seconds 00000100:00100000:2.0:1789445694.495561:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741974400 00000100:00100000:2.0:1789445694.495585:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741974400 00000100:00100000:2.0:1789445694.495654:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789445694.495663:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000947c575b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:5856:x1876369741974400:12345-0@lo:104: 00010000:00010000:2.0:1789445694.495676:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: 00000000e20a8014/0xc1b37c4d47255e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255e3e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.495726:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789445694.495731:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000947c575b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:5856:x1876369741974400:12345-0@lo:104: Request processed in 71us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445694.495737:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789445694.495759:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445694.495764:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: 00000000e20a8014/0xc1b37c4d47255e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255e3e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.495771:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e20a8014 already unused, calling callback (000000007ca8d4fd) 10000000:00010000:2.0:1789445694.495774:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: 00000000e20a8014/0xc1b37c4d47255e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255e3e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.495782:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: 00000000e20a8014/0xc1b37c4d47255e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255e3e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789445694.495788:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: 00000000e20a8014/0xc1b37c4d47255e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255e3e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445694.495794:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789445694.495825:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: 00000000e20a8014/0xc1b37c4d47255e37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255e3e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.495832:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789445694.495850:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: 00000000e20a8014/0xc1b37c4d47255e37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255e3e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.495863:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: 00000000e20a8014/0xc1b37c4d47255e37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255e3e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.495880:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445694.495882:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445694.495884:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445694.495942:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5d2a363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741974528:0@lo:103: 00000100:00100000:2.0:1789445694.495970:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445694.496034:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741974528 00000100:00100000:2.0:1789445694.496038:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741974528 00010000:00010000:2.0:1789445694.496091:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006978239d/0xc1b37c4d47255e3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255e37 expref: 13 pid: 5836 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445694.496111:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789445694.496117:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b4395ae6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:3311:x1876369741974528:12345-0@lo:103: 00010000:00010000:2.0:1789445694.496128:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445694.496132:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006978239d/0xc1b37c4d47255e3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255e37 expref: 13 pid: 5836 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.496141:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006978239d/0xc1b37c4d47255e3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255e37 expref: 13 pid: 5836 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.496156:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000019d9b1b6/0xc1b37c4d47255e6f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.496163:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000019d9b1b6/0xc1b37c4d47255e6f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789445694.496177:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001044098s 00010000:00010000:2.0:1789445694.496186:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000019d9b1b6/0xc1b37c4d47255e6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.496193:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000019d9b1b6/0xc1b37c4d47255e6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.496199:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000019d9b1b6/0xc1b37c4d47255e6f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.496204:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000019d9b1b6/0xc1b37c4d47255e6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.496209:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000019d9b1b6 already unused, calling callback (00000000e61a8462) 00010000:00010000:2.0:1789445694.496213:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000019d9b1b6/0xc1b37c4d47255e6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.496219:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000019d9b1b6/0xc1b37c4d47255e6f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.496228:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000019d9b1b6/0xc1b37c4d47255e6f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445694.496241:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445694.496269:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b4395ae6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:3311:x1876369741974528:12345-0@lo:103: Request processed in 153us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445694.496289:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789445694.496333:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5d2a363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741974528:0@lo:103: 00010000:00010000:0.0:1789445694.496603:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006978239d/0xc1b37c4d47255e3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255e37 expref: 12 pid: 5836 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445694.496625:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000699a20fa pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876369741974400:0@lo:104: 00010000:00010000:0.0:1789445694.496638:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000019d9b1b6/0xc1b37c4d47255e6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445694.496646:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000019d9b1b6/0xc1b37c4d47255e6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445694.496662:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000019d9b1b6/0xc1b37c4d47255e6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445694.496667:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000019d9b1b6/0xc1b37c4d47255e6f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445694.515301:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fca05b27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:5822:x1876369741974272:12345-0@lo:253: Request processed in 76030us (76538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445694.515321:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789445694.515555:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098a84655 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5822:1876369741974272:0@lo:253: 10000000:01000000:3.0:1789445694.515574:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789445694.515578:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789445694.515580:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789445694.515581:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789445694.515583:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789445694.515584:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789445694.515586:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789445694.515587:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789445694.515589:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789445694.515590:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789445694.515592:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789445694.515594:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789445694.515596:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789445694.515615:0:5822:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789445694.522312:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789445694.523299:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789445694.523695:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789445694.523976:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789445694.525482:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789445694.525842:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789445694.527509:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789445694.528482:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789445694.529367:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789445694.529921:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789445694.530237:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789445694.530444:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1789445694.573649:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789445694.609905:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789445694.610297:0:5873:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789445694.610303:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789445694.611507:0:5874:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789445694.628335:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789445694.628821:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789445694.629262:0:5822:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789445694.629272:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789445694.629588:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789445694.630940:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789445694.631957:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789445694.632002:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789445694.632523:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789445694.632835:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1789445694.634611:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789445694.634762:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789445694.634916:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789445694.635087:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789445694.635237:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789445694.639842:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789445694.640153:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789445694.640307:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789445694.640547:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789445694.640807:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789445694.640984:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789445694.641396:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789445694.641548:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789445694.641774:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789445694.641925:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789445694.642126:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789445694.642443:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789445694.642589:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789445694.643322:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789445694.643554:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789445694.643803:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789445694.643970:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789445694.644257:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789445694.645223:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789445694.645664:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789445694.645814:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789445694.645965:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789445694.646174:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789445694.646336:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789445694.646552:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789445694.646693:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789445694.646829:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789445694.647097:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1789445694.673309:0:5874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789445694.733093:0:5822:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789445694.733142:0:5822:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb24d41c5b988 00100000:10000000:3.0:1789445694.733154:0:5822:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789445694.738194:0:5822:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789445694.738216:0:5822:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.159@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789445694.738233:0:5822:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789445694.738253:0:5822:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1789445694.838739:0:5874:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789445694.838837:0:5874:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789445694.838842:0:5874:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789445695.195716:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445696.218303:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445697.244247:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445698.275453:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789445698.523807:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789445698.523815:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afe9d560800 from 3 10000000:01000000:2.0:1789445698.523820:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789445698.523865:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: 00000000cdd818ab/0xc1b37c4d47255e76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445698.523877:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: 00000000cdd818ab/0xc1b37c4d47255e76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445698.523886:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: 00000000cdd818ab/0xc1b37c4d47255e76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445698.523908:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d5d2a363 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741974656:0@lo:101: 00000100:00100000:2.0:1789445698.523967:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445698.524025:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c872d0ea going to sleep for 11 seconds 00000100:00100000:0.0:1789445698.524268:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741974656 00000100:00100000:0.0:1789445698.524276:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741974656 00000100:00100000:0.0:1789445698.524327:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789445698.524335:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000053c574cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:5838:x1876369741974656:12345-0@lo:101: 00010000:00010000:0.0:1789445698.524347:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445698.524358:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000099e82c91/0xc1b37c4d47255e7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255e76 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445698.524378:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000099e82c91/0xc1b37c4d47255e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255e76 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445698.524388:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000099e82c91/0xc1b37c4d47255e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255e76 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445698.524396:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000099e82c91, rc 0) 00000100:00100000:0.0:1789445698.524435:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000053c574cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5838:x1876369741974656:12345-0@lo:101: Request processed in 101us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445698.524441:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789445698.524491:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d5d2a363 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741974656:0@lo:101: 00010000:00010000:0.0:1789445698.524503:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: 00000000cdd818ab/0xc1b37c4d47255e76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255e7d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445698.524511:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: 00000000cdd818ab/0xc1b37c4d47255e76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255e7d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445698.524553:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000699a20fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741974784:0@lo:256: 00000100:00100000:0.0:1789445698.524580:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445698.524598:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a9be7e3d going to sleep for 11 seconds 00000100:00100000:2.0:1789445698.524659:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741974784 00000100:00100000:2.0:1789445698.524725:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741974784 00000100:00100000:2.0:1789445698.524826:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789445698.524834:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b5df2eba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5838:x1876369741974784:12345-0@lo:256: 20000000:01000000:2.0:1789445698.524848:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789445698.524863:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789445698.524866:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789445698.524932:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b5df2eba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5838:x1876369741974784:12345-0@lo:256: Request processed in 99us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445698.524938:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789445698.525020:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000699a20fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741974784:0@lo:256: 10000000:01000000:0.0:1789445698.525075:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789445698.525081:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: 00000000cdd818ab/0xc1b37c4d47255e76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255e7d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445698.525088:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: 00000000cdd818ab/0xc1b37c4d47255e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255e7d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:0.0:1789445699.092030:0:6117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg659-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789445699.295212:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789445699.674959:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789445699.674972:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789445699.674976:0:8:0:(import.c:65:import_set_state_nolock()) 00000000770df54d lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789445699.674997:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000770df54d using connection 192.168.206.159@tcp/0@lo 00000100:00100000:3.0:1789445699.675024:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c4263dc9 x1876369741975040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789445699.675418:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4263dc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876369741975040:0@lo:38: 00000100:00100000:2.0:1789445699.675515:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445699.675549:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ce16d64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369741974912:0@lo:400: 00000100:00100000:1.0:1789445699.675639:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445699.675786:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741974912 00000100:00100000:0.0:1789445699.675798:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741974912 00000100:00100000:0.0:1789445699.675856:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789445699.675865:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ec42d944 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:3312:x1876369741974912:12345-0@lo:400: 00000100:00100000:0.0:1789445699.675949:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ec42d944 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:3312:x1876369741974912:12345-0@lo:400: Request processed in 84us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445699.675956:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789445699.676089:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ce16d64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369741974912:0@lo:400: 00000100:00100000:3.0:1789445699.676314:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741975040 00000100:00100000:3.0:1789445699.676321:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741975040 00000100:00100000:3.0:1789445699.676346:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789445699.676359:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009d96d618 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1876369741975040:12345-0@lo:38: 00010000:00080000:3.0:1789445699.676386:0:5842:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 137 last 0 00000020:00000080:3.0:1789445699.676429:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc1b37c4d47255e84 00000004:00100000:3.0:1789445699.676487:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789445699.676993:0:5842:0:(import.c:65:import_set_state_nolock()) 00000000695eef6c : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789445699.677582:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009d96d618 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876369741975040:12345-0@lo:38: Request processed in 1220us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445699.677602:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789445699.678426:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c4263dc9 x1876369741975040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789445709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789445699.678466:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789445699.678476:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789445699.678482:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789445699.678486:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000770df54d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789445699.678493:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4263dc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876369741975040:0@lo:38: 00010000:00010000:3.0:1789445700.314260:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445701.339154:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445702.362218:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445703.388138:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789445703.702942:0:6318:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe39341b30 20000000:00000080:2.0:1789445703.702959:0:6318:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9afe9f97d400 uarg=0000000000000000 20000000:01000000:2.0:1789445703.702992:0:6318:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789445703.702998:0:6318:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789445703.703003:0:6318:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789445703.704366:0:6318:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789445703.704382:0:6318:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789445703.709426:0:6318:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789445703.709689:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789445703.709754:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789445703.709808:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789445703.709824:0:6318:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789445703.709841:0:6318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000074a4b9ba/0xc1b37c4d47255e8b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445703.709893:0:6318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006a95884b/0xc1b37c4d47255e4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255e45 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445703.709901:0:6318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000074a4b9ba/0xc1b37c4d47255e8b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445703.709937:0:6318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006a95884b/0xc1b37c4d47255e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255e45 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445703.709961:0:6318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006a95884b/0xc1b37c4d47255e4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255e45 expref: 11 pid: 5834 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445703.709975:0:6318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a55fece pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6318:1876369741975168:0@lo:104: 00000100:00100000:2.0:1789445703.710078:0:6318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445703.710118:0:6318:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003e3b92e going to sleep for 11 seconds 00000100:00100000:0.0:1789445703.710433:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741975168 00000100:00100000:0.0:1789445703.710441:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741975168 00000100:00100000:0.0:1789445703.710488:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789445703.710497:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002fb757f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:6318:x1876369741975168:12345-0@lo:104: 00010000:00010000:0.0:1789445703.710509:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: 00000000c2046527/0xc1b37c4d47255e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255e4c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445703.710581:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789445703.710586:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002fb757f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:6318:x1876369741975168:12345-0@lo:104: Request processed in 91us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445703.710605:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789445703.710626:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445703.710631:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: 00000000c2046527/0xc1b37c4d47255e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255e4c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445703.710638:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c2046527 already unused, calling callback (000000007ca8d4fd) 10000000:00010000:0.0:1789445703.710641:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: 00000000c2046527/0xc1b37c4d47255e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255e4c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445703.710647:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: 00000000c2046527/0xc1b37c4d47255e45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255e4c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789445703.710653:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: 00000000c2046527/0xc1b37c4d47255e45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255e4c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445703.710659:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789445703.710684:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: 00000000c2046527/0xc1b37c4d47255e45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255e4c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445703.710690:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789445703.710713:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: 00000000c2046527/0xc1b37c4d47255e45 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255e4c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445703.710719:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: 00000000c2046527/0xc1b37c4d47255e45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255e4c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445703.710735:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445703.710737:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445703.710738:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445703.710755:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000699a20fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369741975296:0@lo:103: 00000100:00100000:0.0:1789445703.710783:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445703.710824:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741975296 00000100:00100000:0.0:1789445703.710828:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741975296 00010000:00010000:0.0:1789445703.710842:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006a95884b/0xc1b37c4d47255e4c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255e45 expref: 12 pid: 5834 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445703.710864:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789445703.710870:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a9d624 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:3313:x1876369741975296:12345-0@lo:103: 00010000:00010000:0.0:1789445703.710879:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445703.710883:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006a95884b/0xc1b37c4d47255e4c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255e45 expref: 12 pid: 5834 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445703.710891:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006a95884b/0xc1b37c4d47255e4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255e45 expref: 12 pid: 5834 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445703.710904:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000074a4b9ba/0xc1b37c4d47255e8b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445703.710910:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000074a4b9ba/0xc1b37c4d47255e8b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445703.710930:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000074a4b9ba/0xc1b37c4d47255e8b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445703.710936:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000074a4b9ba/0xc1b37c4d47255e8b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445703.710942:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000074a4b9ba/0xc1b37c4d47255e8b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445703.710947:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000074a4b9ba/0xc1b37c4d47255e8b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445703.710951:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000074a4b9ba already unused, calling callback (00000000e61a8462) 00010000:00010000:0.0:1789445703.710954:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000074a4b9ba/0xc1b37c4d47255e8b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445703.710959:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000074a4b9ba/0xc1b37c4d47255e8b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445703.710966:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000074a4b9ba/0xc1b37c4d47255e8b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445703.710975:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445703.711002:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a9d624 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:3313:x1876369741975296:12345-0@lo:103: Request processed in 134us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445703.711008:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789445703.711039:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000699a20fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369741975296:0@lo:103: 00010000:00010000:2.0:1789445703.711137:0:6318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006a95884b/0xc1b37c4d47255e4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255e45 expref: 11 pid: 5834 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445703.711146:0:6318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a55fece pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6318:1876369741975168:0@lo:104: 00010000:00010000:2.0:1789445703.711174:0:6318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000074a4b9ba/0xc1b37c4d47255e8b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445703.711182:0:6318:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000074a4b9ba/0xc1b37c4d47255e8b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445703.711188:0:6318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000074a4b9ba/0xc1b37c4d47255e8b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445703.711193:0:6318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000074a4b9ba/0xc1b37c4d47255e8b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445704.411174:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789445704.474155:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789445704.474163:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afe9d560800 from 1 10000000:01000000:0.0:1789445704.474168:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789445704.474222:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: 00000000f11e1a07/0xc1b37c4d47255e92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445704.474256:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: 00000000f11e1a07/0xc1b37c4d47255e92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445704.474266:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: 00000000f11e1a07/0xc1b37c4d47255e92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445704.474290:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000699a20fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741975424:0@lo:101: 00000100:00100000:0.0:1789445704.474356:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445704.474482:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b208205a going to sleep for 11 seconds 00000100:00100000:1.0:1789445704.474537:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741975424 00000100:00100000:1.0:1789445704.474545:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741975424 00000100:00100000:1.0:1789445704.474599:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789445704.474608:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000096b8afc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:5838:x1876369741975424:12345-0@lo:101: 00010000:00010000:1.0:1789445704.474619:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445704.474632:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038120620/0xc1b37c4d47255e99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255e92 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445704.474651:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038120620/0xc1b37c4d47255e99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255e92 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445704.474660:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038120620/0xc1b37c4d47255e99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255e92 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445704.474674:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038120620, rc 0) 00000100:00100000:1.0:1789445704.474712:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000096b8afc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5838:x1876369741975424:12345-0@lo:101: Request processed in 106us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445704.474718:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789445704.477388:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000699a20fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741975424:0@lo:101: 00010000:00010000:2.0:1789445704.477416:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: 00000000f11e1a07/0xc1b37c4d47255e92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255e99 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445704.477429:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: 00000000f11e1a07/0xc1b37c4d47255e92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255e99 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445704.477521:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a55fece pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741975552:0@lo:501: 00000100:00100000:2.0:1789445704.477574:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445704.477655:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8abf133 going to sleep for 11 seconds 00000100:00100000:0.0:1789445704.477744:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741975552 00000100:00100000:0.0:1789445704.477751:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741975552 00000100:00100000:0.0:1789445704.477834:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789445704.477843:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001878558a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5838:x1876369741975552:12345-0@lo:501: 00000100:00100000:0.0:1789445704.479483:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001878558a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5838:x1876369741975552:12345-0@lo:501: Request processed in 1636us (1903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445704.479495:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789445704.479597:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a55fece pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741975552:0@lo:501: 00000100:00100000:2.0:1789445704.479637:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a55fece pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741975680:0@lo:503: 00000100:00100000:2.0:1789445704.479679:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445704.484347:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8abf133 going to sleep for 11 seconds 00000100:00100000:1.0:1789445704.484826:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741975680 00000100:00100000:1.0:1789445704.484837:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741975680 00000100:00100000:1.0:1789445704.484896:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789445704.484904:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000025e0a544 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5838:x1876369741975680:12345-0@lo:503: 00000100:00100000:1.0:1789445704.485122:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000025e0a544 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5838:x1876369741975680:12345-0@lo:503: Request processed in 219us (5442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445704.485130:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789445704.485485:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a55fece pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741975680:0@lo:503: 00000100:00100000:2.0:1789445704.485830:0:6349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a55fece pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6349:1876369741975808:0@lo:502: 00000100:00100000:2.0:1789445704.485889:0:6349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445704.485924:0:6349:0:(client.c:2716:ptlrpc_set_wait()) set 000000005aae723e going to sleep for 11 seconds 00000100:00100000:1.0:1789445704.486036:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741975808 00000100:00100000:1.0:1789445704.486042:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741975808 00000100:00100000:1.0:1789445704.486097:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789445704.486103:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c78253c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:6349:x1876369741975808:12345-0@lo:502: 00000100:00100000:1.0:1789445704.486262:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c78253c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:6349:x1876369741975808:12345-0@lo:502: Request processed in 159us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445704.486269:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789445704.486399:0:6349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a55fece pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6349:1876369741975808:0@lo:502: 00000020:01000000:2.0:1789445704.486421:0:6349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789445704.486430:0:6349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445704.486432:0:6349:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789445704.486438:0:6349:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afe9d560800 00000020:00000080:2.0:1789445704.486441:0:6349:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789445704.486474:0:6349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6349:1876369741975936:0@lo:502: 00000100:00100000:2.0:1789445704.486503:0:6349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445704.486531:0:6349:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4e22f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789445704.487199:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741975936 00000100:00100000:1.0:1789445704.487207:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741975936 00000100:00100000:1.0:1789445704.487251:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789445704.487258:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:6349:x1876369741975936:12345-0@lo:502: 00000100:00100000:1.0:1789445704.487390:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:6349:x1876369741975936:12345-0@lo:502: Request processed in 132us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445704.487396:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789445704.487626:0:6349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6349:1876369741975936:0@lo:502: 00000020:01000000:2.0:1789445704.487649:0:6349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789445704.487655:0:6349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445704.487657:0:6349:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789445704.487667:0:6349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789445704.487929:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789445704.487953:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789445704.487962:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e989600/0xc1b37c4d47255e92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255e99 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445704.487972:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe8e989600/0xc1b37c4d47255e92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255e99 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445704.794319:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789445704.797327:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876369741976064:0@lo:400: 00000100:00100000:1.0:1789445704.797406:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445704.797626:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741976064 00000100:00100000:3.0:1789445704.797635:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741976064 00000100:00100000:3.0:1789445704.797686:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789445704.797695:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876369741976064:12345-0@lo:400: 00000100:00100000:3.0:1789445704.797771:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876369741976064:12345-0@lo:400: Request processed in 77us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445704.797778:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789445704.797821:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9afeadb98e00 x1876369741976064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445704.797835:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876369741976064:0@lo:400: 00010000:00010000:0.0:1789445705.434323:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445706.461086:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445707.482989:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445708.507187:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445709.530393:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445709.914979:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369741976320:0@lo:400: 00000100:00100000:2.0:1789445709.915101:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445709.915212:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741976320 00000100:00100000:2.0:1789445709.915221:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741976320 00000100:00100000:2.0:1789445709.915281:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789445709.915292:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369741976320:12345-0@lo:400: 00000100:00100000:2.0:1789445709.915353:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369741976320:12345-0@lo:400: Request processed in 62us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445709.915360:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789445709.915409:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9afea4d41c00 x1876369741976320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445709.915425:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369741976320:0@lo:400: 00000100:00100000:3.0:1789445709.915644:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741976192:0@lo:400: 00000100:00100000:3.0:1789445709.915763:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445709.916509:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741976192 00000100:00100000:2.0:1789445709.916517:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741976192 00000100:00100000:2.0:1789445709.916641:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789445709.916651:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:3311:x1876369741976192:12345-0@lo:400: 00000100:00100000:2.0:1789445709.916797:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:3311:x1876369741976192:12345-0@lo:400: Request processed in 147us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445709.916805:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789445709.916859:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741976192:0@lo:400: 00000020:01000004:3.0:1789445709.989671:0:6680:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789445709.989743:0:6680:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789445709.989977:0:6680:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9afe8533d800 00000020:01000004:3.0:1789445709.990003:0:6680:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789445709.990379:0:6680:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789445709.990568:0:6680:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9afea4f919c0) 00000020:00000080:2.0:1789445709.990590:0:6680:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789445710.022461:0:6680:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789445710.029388:0:6680:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789445710.073988:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789445710.091165:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789445710.091219:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789445710.091286:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789445710.091329:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789445710.092208:0:6680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789445710.092225:0:6680:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789445710.092243:0:6680:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc1b37c4d47255ea7 00000020:01000004:3.0:1789445710.092255:0:6680:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789445710.092281:0:6680:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.159@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789445710.092285:0:6680:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789445710.092292:0:6680:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789445710.092297:0:6680:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789445710.092314:0:6680:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9afe85c3b380) 00000020:00000080:3.0:1789445710.092329:0:6680:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789445710.094641:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789445710.095188:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789445710.095196:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789445710.105101:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789445710.105118:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789445710.107602:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789445710.107616:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789445710.110641:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789445710.111346:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789445710.111356:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789445710.112480:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789445710.112495:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789445710.143389:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789445710.143692:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789445710.143700:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789445710.145825:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789445710.145841:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789445710.147350:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789445710.147366:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789445710.150426:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789445710.150686:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789445710.150694:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789445710.152838:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789445710.152852:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789445710.245454:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789445710.246371:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789445710.246401:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789445710.247588:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789445710.247603:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789445710.248628:0:6680:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789445710.248657:0:6680:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789445710.248665:0:6680:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.159@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789445710.296184:0:6680:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.159@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789445710.296306:0:6680:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.159@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1789445710.296311:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789445710.296313:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789445710.296315:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789445710.296319:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789445710.296320:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789445710.296322:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789445710.296323:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789445710.296325:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789445710.296326:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789445710.296328:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789445710.296329:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789445710.296334:0:6680:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1789445710.296336:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789445710.296338:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789445710.296339:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789445710.296340:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789445710.296340:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789445710.296342:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789445710.296342:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789445710.296343:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789445710.296344:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789445710.296345:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789445710.296346:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789445710.296378:0:6680:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789445710.296398:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741976448:0@lo:253: 00000100:00100000:1.0:1789445710.296479:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445710.296614:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4e22540 going to sleep for 11 seconds 00000100:00100000:3.0:1789445710.296813:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741976448 00000100:00100000:3.0:1789445710.296822:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741976448 00000100:00100000:3.0:1789445710.296931:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789445710.296943:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:6680:x1876369741976448:12345-0@lo:253: 20000000:01000000:3.0:1789445710.296991:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789445710.296995:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789445710.297000:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789445710.297004:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789445710.298106:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789445710.298363:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789445710.298380:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789445710.298423:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1789445710.298430:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789445710.298475:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1789445710.298525:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1789445710.298912:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789445710.298934:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.159@tcp 20000000:01000000:3.0:1789445710.298937:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.159@tcp (null) (null) (null) 00000040:00080000:3.0:1789445710.298973:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789445710.298981:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789445710.299028:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789445710.299036:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.159@tcp (null) (null) 00000040:00080000:3.0:1789445710.299122:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789445710.299133:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789445710.299165:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789445710.299224:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1789445710.302397:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1789445710.302456:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.159@tcp 20000000:01000000:2.0:1789445710.302459:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.159@tcp (null) (null) (null) 00000040:00080000:2.0:1789445710.302536:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1789445710.302545:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789445710.302592:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1789445710.302600:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.159@tcp (null) (null) 00000040:00080000:2.0:1789445710.302653:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1789445710.302664:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789445710.302699:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1789445710.302736:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1789445710.303530:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789445710.303536:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789445710.303541:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789445710.303559:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789445710.303611:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789445710.303663:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789445710.303667:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789445710.306994:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789445710.307269:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789445710.307332:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789445710.311478:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789445710.312985:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789445710.313390:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789445710.313419:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789445710.313423:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789445710.315029:0:6696:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1789445710.315173:0:6696:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1789445710.315262:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789445710.316002:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1789445710.316107:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789445710.316147:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1789445710.316162:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789445710.316165:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789445710.317035:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789445710.317486:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1789445710.317532:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1789445710.317890:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1789445710.318523:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1789445710.318528:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1789445710.318540:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789445710.318584:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255eb5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445710.318607:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d47255dce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255dc7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445710.318627:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255dea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255de3 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445710.318634:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe81504e00/0xc1b37c4d47255e5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255e53 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445710.318641:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255eb5 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445710.318693:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe81504e00/0xc1b37c4d47255e5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255e53 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445710.318710:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe81504e00/0xc1b37c4d47255e5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255e53 expref: 12 pid: 5835 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445710.318726:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876369741976576:0@lo:104: 00000100:00100000:2.0:1789445710.318882:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789445710.319113:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255de3 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445710.319123:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255dea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255de3 expref: 12 pid: 5836 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445710.319132:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876369741976704:0@lo:104: 00000100:00100000:2.0:1789445710.319156:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789445710.319182:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d47255dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255dc7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445710.319191:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d47255dce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255dc7 expref: 12 pid: 5835 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445710.319372:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876369741976832:0@lo:104: 00000100:00100000:2.0:1789445710.319395:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445710.319408:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4ebed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789445710.319505:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741976576 00000100:00100000:3.0:1789445710.319515:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741976576 00000100:00100000:3.0:1789445710.319579:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741976704 00000100:00100000:3.0:1789445710.319582:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741976704 00000100:00100000:3.0:1789445710.319593:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741976832 00000100:00100000:3.0:1789445710.319595:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741976832 00000100:00100000:3.0:1789445710.319608:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789445710.319618:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:5836:x1876369741976576:12345-0@lo:104: 00010000:00010000:3.0:1789445710.319632:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255e53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255e5a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.319710:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789445710.319716:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:5836:x1876369741976576:12345-0@lo:104: Request processed in 101us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445710.319724:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789445710.319992:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789445710.320001:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+4:5836:x1876369741976704:12345-0@lo:104: 00010000:00010000:3.0:1789445710.320010:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe81505e00/0xc1b37c4d47255de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255dea expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.320084:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789445710.320090:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+4:5836:x1876369741976704:12345-0@lo:104: Request processed in 92us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445710.320097:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789445710.320110:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789445710.320117:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:5836:x1876369741976832:12345-0@lo:104: 00010000:00010000:3.0:1789445710.320124:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255dc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255dce expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.320151:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789445710.320156:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:5836:x1876369741976832:12345-0@lo:104: Request processed in 41us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445710.320162:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789445710.320253:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789445710.320262:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255e53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255e5a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.320269:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fd200 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:1.0:1789445710.320273:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255e53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255e5a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.320283:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255e53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255e5a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789445710.320290:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255e53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255e5a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445710.320304:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789445710.320348:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255e53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255e5a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.320354:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789445710.320372:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255e53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255e5a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.320379:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255e53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255e5a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.320395:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789445710.320398:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81505e00/0xc1b37c4d47255de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255dea expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.320403:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81505e00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:1.0:1789445710.320406:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81505e00/0xc1b37c4d47255de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255dea expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.320411:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81505e00/0xc1b37c4d47255de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255dea expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789445710.320417:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81505e00/0xc1b37c4d47255de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255dea expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445710.320421:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789445710.320432:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe81505e00/0xc1b37c4d47255de3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255dea expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.320437:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789445710.320461:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81505e00/0xc1b37c4d47255de3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255dea expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.320468:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81505e00/0xc1b37c4d47255de3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255dea expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.320478:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789445710.320481:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255dc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255dce expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.320486:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81504a00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:1.0:1789445710.320489:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255dc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255dce expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.320495:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255dce expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789445710.320501:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255dce expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445710.320505:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789445710.320517:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255dc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255dce expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.320522:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789445710.320526:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255dc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255dce expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.320532:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255dc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255dce expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.320548:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445710.320553:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445710.320555:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445710.320587:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369741977088:0@lo:103: 00000100:00100000:1.0:1789445710.320624:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445710.320650:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789445710.320655:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369741977216:0@lo:103: 00000100:00100000:1.0:1789445710.320672:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789445710.320939:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445710.320954:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741977088 00000100:00100000:0.0:1789445710.320961:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741977088 00010000:00010000:0.0:1789445710.320990:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255dea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255de3 expref: 13 pid: 5836 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445710.321021:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741977216 00000100:00100000:0.0:1789445710.321024:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741977216 00010000:00010000:0.0:1789445710.321035:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d47255dce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255dc7 expref: 14 pid: 5835 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445710.321068:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789445710.321076:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:3310:x1876369741977088:12345-0@lo:103: 00010000:00010000:0.0:1789445710.321089:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445710.321095:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255dea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255de3 expref: 14 pid: 5836 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.321104:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255dea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255de3 expref: 14 pid: 5836 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.321123:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445710.321163:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:3310:x1876369741977088:12345-0@lo:103: Request processed in 88us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445710.321178:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789445710.321192:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789445710.321197:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:3310:x1876369741977216:12345-0@lo:103: 00010000:00010000:0.0:1789445710.321221:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445710.321225:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d47255dce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255dc7 expref: 13 pid: 5835 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.321233:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d47255dce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255dc7 expref: 13 pid: 5835 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.321244:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445710.321266:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:3310:x1876369741977216:12345-0@lo:103: Request processed in 69us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445710.321272:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789445710.321314:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369741977216:0@lo:103: 00000100:00100000:0.0:1789445710.321322:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369741977088:0@lo:103: 00000100:00100000:2.0:1789445710.322114:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369741976960:0@lo:103: 00000100:00100000:2.0:1789445710.322166:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445710.322269:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876369741976576:0@lo:104: 00010000:00010000:2.0:1789445710.322280:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255dea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255de3 expref: 12 pid: 5836 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445710.322296:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876369741976704:0@lo:104: 00010000:00010000:2.0:1789445710.322305:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d47255dce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255dc7 expref: 11 pid: 5835 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445710.322313:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876369741976832:0@lo:104: 00010000:00010000:2.0:1789445710.322337:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255eb5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445710.322548:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741976960 00000100:00100000:1.0:1789445710.322555:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741976960 00010000:00010000:1.0:1789445710.322708:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe81504e00/0xc1b37c4d47255e5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255e53 expref: 11 pid: 5835 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445710.322738:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789445710.322811:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:3313:x1876369741976960:12345-0@lo:103: 00010000:00010000:1.0:1789445710.322825:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445710.322830:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe81504e00/0xc1b37c4d47255e5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255e53 expref: 11 pid: 5835 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.322842:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe81504e00/0xc1b37c4d47255e5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255e53 expref: 11 pid: 5835 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.322856:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81504e00/0xc1b37c4d47255e5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255e53 expref: 11 pid: 5835 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.322873:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255eb5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.322881:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255eb5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.322967:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255eb5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.322981:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255eb5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.322988:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255eb5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.322995:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255eb5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.323002:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81505000 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445710.323006:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255eb5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.323015:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255eb5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.330776:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255eb5 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.330800:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255eb5 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789445710.330843:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1789445710.332798:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255eb5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.332825:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255eb5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.332859:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445710.332990:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+10:3313:x1876369741976960:12345-0@lo:103: Request processed in 10177us (10818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445710.333002:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789445710.333406:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369741976960:0@lo:103: 00000100:00100000:2.0:1789445710.438591:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+9:6680:x1876369741976448:12345-0@lo:253: Request processed in 141638us (142098us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445710.438610:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789445710.438811:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741976448:0@lo:253: 10000000:01000000:1.0:1789445710.438831:0:6680:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789445710.438835:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789445710.438853:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789445710.438855:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789445710.438869:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1789445710.438870:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789445710.438871:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789445710.438873:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789445710.438875:0:6680:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789445710.438876:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789445710.438877:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789445710.438904:0:6680:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9afe8533d800 from lustre-OST0000 10000000:01000000:1.0:1789445710.438939:0:6680:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789445710.438943:0:6680:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789445710.438950:0:6680:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9afea4f94d40 local copy 10000000:01000000:1.0:1789445710.438956:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789445710.439001:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d47255ebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.439355:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d47255ebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.439366:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d47255ebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445710.439388:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741977344:0@lo:101: 00000100:00100000:1.0:1789445710.439437:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445710.439500:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896bb840 going to sleep for 11 seconds 00000100:00100000:3.0:1789445710.439666:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741977344 00000100:00100000:3.0:1789445710.439674:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741977344 00000100:00100000:3.0:1789445710.439725:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789445710.439735:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+9:6680:x1876369741977344:12345-0@lo:101: 00010000:00010000:3.0:1789445710.439750:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445710.439870:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe813fc200/0xc1b37c4d47255ec3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255ebc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.439899:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe813fc200/0xc1b37c4d47255ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255ebc expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.439911:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe813fc200/0xc1b37c4d47255ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255ebc expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.439921:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fc200, rc 0) 00000100:00100000:3.0:1789445710.440018:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+10:6680:x1876369741977344:12345-0@lo:101: Request processed in 284us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445710.440025:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789445710.447396:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741977344:0@lo:101: 00010000:00010000:1.0:1789445710.447438:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d47255ebc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc1b37c4d47255ec3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.447454:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d47255ebc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc1b37c4d47255ec3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445710.450643:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741977472:0@lo:501: 00000100:00100000:0.0:1789445710.450739:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445710.450903:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe90c516c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445710.451487:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741977472 00000100:00100000:2.0:1789445710.451499:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741977472 00000100:00100000:2.0:1789445710.451607:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789445710.451619:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+10:6680:x1876369741977472:12345-0@lo:501: 00000100:00100000:2.0:1789445710.451942:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+10:6680:x1876369741977472:12345-0@lo:501: Request processed in 324us (1202us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789445710.451962:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789445710.452122:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741977472:0@lo:501: 10000000:01000000:0.0:1789445710.452148:0:6680:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789445710.452185:0:6680:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789445710.452195:0:6680:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d47255ebc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc1b37c4d47255ec3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.452218:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d47255ebc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc1b37c4d47255ec3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.452233:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d47255ebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc1b37c4d47255ec3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.452253:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789445710.452278:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9afe8533d800 10000000:01000000:0.0:1789445710.452283:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789445710.452288:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9afea4f94d40 10000000:01000000:0.0:1789445710.452291:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789445710.452295:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9afea4f94d40 from 1 10000000:01000000:0.0:1789445710.452299:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789445710.452333:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e989800/0xc1b37c4d47255eca lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.452342:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe8e989800/0xc1b37c4d47255eca lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.452352:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe8e989800/0xc1b37c4d47255eca lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445710.452370:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741977600:0@lo:101: 00000100:00100000:0.0:1789445710.452406:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789445710.452720:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789445710.452728:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d47255ebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc1b37c4d47255ec3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.452736:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81678200 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:3.0:1789445710.452740:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d47255ebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc1b37c4d47255ec3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.452774:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d47255ebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc1b37c4d47255ec3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789445710.452782:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d47255ebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc1b37c4d47255ec3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789445710.452788:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789445710.452811:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d47255ebc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc1b37c4d47255ec3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.452818:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789445710.452843:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d47255ebc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc1b37c4d47255ec3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.452851:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d47255ebc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc1b37c4d47255ec3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.452871:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445710.452873:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445710.452875:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445710.452887:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369741977728:0@lo:103: 00000100:00100000:3.0:1789445710.452923:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445710.452999:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741977728 00000100:00100000:3.0:1789445710.453018:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741977728 00000100:00100000:3.0:1789445710.453332:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789445710.453343:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+10:3312:x1876369741977728:12345-0@lo:103: 00010000:00010000:3.0:1789445710.453358:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445710.453374:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe813fc200/0xc1b37c4d47255ec3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1b37c4d47255ebc expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.453400:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445710.453441:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+9:3312:x1876369741977728:12345-0@lo:103: Request processed in 101us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445710.453448:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789445710.453505:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369741977728:0@lo:103: 00000100:00100000:0.0:1789445710.459970:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe90c51cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445710.465434:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741977600 00000100:00100000:1.0:1789445710.465454:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741977600 00000100:00100000:0.0:1789445710.466592:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789445710.466609:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+9:6680:x1876369741977600:12345-0@lo:101: 00010000:00010000:0.0:1789445710.466632:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445710.466661:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe8e989e00/0xc1b37c4d47255ed1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255eca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.466721:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe8e989e00/0xc1b37c4d47255ed1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255eca expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.466733:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe8e989e00/0xc1b37c4d47255ed1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255eca expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.466744:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989e00, rc 0) 00000100:00100000:0.0:1789445710.466860:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+10:6680:x1876369741977600:12345-0@lo:101: Request processed in 256us (14454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445710.466867:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789445710.467119:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741977600:0@lo:101: 00010000:00010000:1.0:1789445710.467143:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe8e989800/0xc1b37c4d47255eca lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255ed1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.467155:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe8e989800/0xc1b37c4d47255eca lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255ed1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445710.467181:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789445710.467195:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e989800/0xc1b37c4d47255eca lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255ed1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.467213:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe8e989800/0xc1b37c4d47255eca lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255ed1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445710.467222:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789445710.467228:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789445710.467236:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789445710.467238:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789445710.467269:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d47255ed8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.467276:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d47255ed8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.467283:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d47255ed8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445710.467318:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741977856:0@lo:101: 00000100:00100000:1.0:1789445710.467362:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445710.467400:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896bb840 going to sleep for 11 seconds 00000100:00100000:2.0:1789445710.467624:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741977856 00000100:00100000:2.0:1789445710.467633:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741977856 00000100:00100000:2.0:1789445710.467668:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789445710.467675:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+10:6680:x1876369741977856:12345-0@lo:101: 00010000:00010000:2.0:1789445710.467685:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445710.467698:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255edf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255ed8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445710.467715:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255edf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255ed8 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445710.467724:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255edf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255ed8 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445710.467731:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81505000, rc 0) 00000100:00100000:2.0:1789445710.467777:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:6680:x1876369741977856:12345-0@lo:101: Request processed in 102us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445710.467783:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789445710.467926:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741977856:0@lo:101: 00010000:00010000:1.0:1789445710.467938:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d47255ed8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255edf expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.467946:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d47255ed8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255edf expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445710.468371:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741977984:0@lo:501: 00000100:00100000:0.0:1789445710.468407:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445710.468440:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe90c51d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789445710.468494:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741977984 00000100:00100000:2.0:1789445710.468499:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741977984 00000100:00100000:2.0:1789445710.468532:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789445710.468540:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:6680:x1876369741977984:12345-0@lo:501: 00000100:00100000:2.0:1789445710.468824:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:6680:x1876369741977984:12345-0@lo:501: Request processed in 284us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445710.468832:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789445710.468945:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741977984:0@lo:501: 00000100:00100000:1.0:1789445710.468980:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741978112:0@lo:503: 00000100:00100000:1.0:1789445710.469031:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445710.469082:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896bb840 going to sleep for 11 seconds 00000100:00100000:2.0:1789445710.469329:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741978112 00000100:00100000:2.0:1789445710.469334:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741978112 00000100:00100000:2.0:1789445710.469375:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789445710.469382:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:6680:x1876369741978112:12345-0@lo:503: 00000100:00100000:2.0:1789445710.469563:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:6680:x1876369741978112:12345-0@lo:503: Request processed in 181us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445710.469571:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789445710.469987:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741978112:0@lo:503: 00000040:00080000:1.0:1789445710.470411:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789445710.470506:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741978240:0@lo:502: 00000100:00100000:1.0:1789445710.470556:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445710.470595:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896bb840 going to sleep for 11 seconds 00000100:00100000:2.0:1789445710.470814:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741978240 00000100:00100000:2.0:1789445710.470820:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741978240 00000100:00100000:2.0:1789445710.470849:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789445710.470857:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:6680:x1876369741978240:12345-0@lo:502: 00000100:00100000:2.0:1789445710.471085:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:6680:x1876369741978240:12345-0@lo:502: Request processed in 227us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445710.471093:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789445710.471347:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741978240:0@lo:502: 00000040:00080000:1.0:1789445710.471597:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789445710.471651:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789445710.471685:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789445710.471733:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789445710.471769:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789445710.471812:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789445710.471841:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741978368:0@lo:502: 00000100:00100000:1.0:1789445710.471881:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445710.471921:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896bb840 going to sleep for 11 seconds 00000100:00100000:3.0:1789445710.472423:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741978368 00000100:00100000:3.0:1789445710.472431:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741978368 00000100:00100000:3.0:1789445710.472473:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789445710.472482:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:6680:x1876369741978368:12345-0@lo:502: 00000100:00100000:3.0:1789445710.472673:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:6680:x1876369741978368:12345-0@lo:502: Request processed in 192us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445710.472681:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789445710.472839:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741978368:0@lo:502: 00000040:00080000:1.0:1789445710.472949:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789445710.472961:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1789445710.474514:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789445710.474528:0:6699:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789445710.474537:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445710.474539:0:6699:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789445710.474545:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789445710.474564:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9afeb5c83380) 00000020:00000080:1.0:1789445710.474591:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789445710.474597:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789445710.474686:0:6699:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afe8533d800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789445710.474695:0:6699:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789445710.474703:0:6699:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc1b37c4d47255eed 00010000:00010000:0.0:1789445710.479266:0:6699:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1789445710.482432:0:6699:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1789445710.485795:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789445710.486795:0:6699:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789445710.501748:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789445710.502725:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789445710.504591:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789445710.504608:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789445710.504615:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445710.504618:0:6699:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789445710.504621:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789445710.504626:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445710.504627:0:6699:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789445710.504630:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789445710.504632:0:6699:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789445710.504698:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789445710.504702:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445710.504703:0:6699:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789445710.504706:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789445710.507553:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789445710.507602:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789445710.507631:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d47255ed8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255edf expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.507647:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d47255ed8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255edf expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445710.508548:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afe8533d800 from 1 10000000:01000000:2.0:1789445710.508554:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789445710.508606:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81504e00/0xc1b37c4d47255ef4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445710.508622:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe81504e00/0xc1b37c4d47255ef4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445710.508637:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe81504e00/0xc1b37c4d47255ef4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445710.508666:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741978496:0@lo:101: 00000100:00100000:2.0:1789445710.508752:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445710.508810:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeada9e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789445710.508929:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741978496 00000100:00100000:0.0:1789445710.508937:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741978496 00000100:00100000:0.0:1789445710.508994:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789445710.509002:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:6680:x1876369741978496:12345-0@lo:101: 00010000:00010000:0.0:1789445710.509017:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445710.509031:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe8e989200/0xc1b37c4d47255efb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255ef4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.509079:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe8e989200/0xc1b37c4d47255efb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255ef4 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.509091:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe8e989200/0xc1b37c4d47255efb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255ef4 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.509108:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989200, rc 0) 00000100:00100000:0.0:1789445710.509155:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:6680:x1876369741978496:12345-0@lo:101: Request processed in 154us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445710.509162:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789445710.511659:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741978496:0@lo:101: 00010000:00010000:2.0:1789445710.511694:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe81504e00/0xc1b37c4d47255ef4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255efb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445710.511710:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe81504e00/0xc1b37c4d47255ef4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255efb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445710.512037:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741978624:0@lo:501: 00000100:00100000:2.0:1789445710.512323:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445710.512375:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeada9e180 going to sleep for 11 seconds 00000100:00100000:2.0:1789445710.512402:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741978624 00000100:00100000:2.0:1789445710.512410:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741978624 00000100:00100000:2.0:1789445710.512737:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789445710.512749:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:6680:x1876369741978624:12345-0@lo:501: 00000100:00100000:2.0:1789445710.513245:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:6680:x1876369741978624:12345-0@lo:501: Request processed in 496us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445710.513253:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789445710.513411:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741978624:0@lo:501: 00000100:00100000:3.0:1789445710.513462:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741978752:0@lo:503: 00000100:00100000:3.0:1789445710.513509:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445710.513752:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d5b6600 going to sleep for 11 seconds 00000100:00100000:1.0:1789445710.513808:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741978752 00000100:00100000:1.0:1789445710.513815:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741978752 00000100:00100000:1.0:1789445710.513847:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789445710.513855:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:6680:x1876369741978752:12345-0@lo:503: 00000100:00100000:1.0:1789445710.514447:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:6680:x1876369741978752:12345-0@lo:503: Request processed in 592us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445710.514456:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789445710.514619:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741978752:0@lo:503: 00000040:00080000:3.0:1789445710.514942:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789445710.515086:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741978880:0@lo:502: 00000100:00100000:3.0:1789445710.515312:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445710.515342:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d5b6600 going to sleep for 11 seconds 00000100:00100000:1.0:1789445710.515420:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741978880 00000100:00100000:1.0:1789445710.515426:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741978880 00000100:00100000:1.0:1789445710.515454:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789445710.515463:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:6680:x1876369741978880:12345-0@lo:502: 00000100:00100000:1.0:1789445710.515666:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:6680:x1876369741978880:12345-0@lo:502: Request processed in 205us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445710.515674:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789445710.515772:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741978880:0@lo:502: 00000040:00080000:3.0:1789445710.516257:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789445710.516318:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789445710.516359:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741979008:0@lo:502: 00000100:00100000:3.0:1789445710.516404:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445710.516430:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d5b6600 going to sleep for 11 seconds 00000100:00100000:1.0:1789445710.516558:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741979008 00000100:00100000:1.0:1789445710.516564:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741979008 00000100:00100000:1.0:1789445710.516592:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789445710.516599:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:6680:x1876369741979008:12345-0@lo:502: 00000100:00100000:1.0:1789445710.516743:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:6680:x1876369741979008:12345-0@lo:502: Request processed in 144us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445710.516750:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789445710.516837:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741979008:0@lo:502: 00000040:00080000:3.0:1789445710.516920:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789445710.516928:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789445710.517558:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789445710.517570:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445710.517573:0:6703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789445710.517581:0:6703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afe8533d800 00000020:00000080:3.0:1789445710.517583:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789445710.517605:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789445710.517609:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445710.517610:0:6703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789445710.517614:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789445710.517739:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789445710.517761:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789445710.517784:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81504e00/0xc1b37c4d47255ef4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255efb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.517797:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe81504e00/0xc1b37c4d47255ef4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255efb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445710.517848:0:6680:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789445710.517851:0:6680:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9afe8533d800 10000000:01000000:1.0:1789445710.517854:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9afe8533d800 10000000:01000000:1.0:1789445710.517858:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789445710.517865:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afe8533d800 from 1 10000000:01000000:1.0:1789445710.517868:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789445710.517905:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d47255f02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.517913:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d47255f02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.517939:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d47255f02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445710.517962:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741979136:0@lo:101: 00000100:00100000:1.0:1789445710.518015:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445710.518087:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896bbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789445710.518130:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741979136 00000100:00100000:1.0:1789445710.518137:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741979136 00000100:00100000:1.0:1789445710.518169:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789445710.518177:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:6680:x1876369741979136:12345-0@lo:101: 00010000:00010000:1.0:1789445710.518190:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445710.518215:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81679200/0xc1b37c4d47255f09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255f02 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.518243:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81679200/0xc1b37c4d47255f09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255f02 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.518254:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81679200/0xc1b37c4d47255f09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255f02 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.518263:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81679200, rc 0) 00000100:00100000:1.0:1789445710.518298:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:6680:x1876369741979136:12345-0@lo:101: Request processed in 122us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445710.518305:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789445710.518349:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741979136:0@lo:101: 00010000:00010000:1.0:1789445710.518362:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d47255f02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255f09 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.518380:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d47255f02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255f09 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445710.518472:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741979264:0@lo:501: 00000100:00100000:1.0:1789445710.518496:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445710.518509:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896bbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789445710.518522:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741979264 00000100:00100000:1.0:1789445710.518525:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741979264 00000100:00100000:1.0:1789445710.518541:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789445710.518546:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:6680:x1876369741979264:12345-0@lo:501: 00000100:00100000:1.0:1789445710.518766:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:6680:x1876369741979264:12345-0@lo:501: Request processed in 218us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445710.518773:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789445710.518802:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741979264:0@lo:501: 00000100:00100000:1.0:1789445710.518826:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741979392:0@lo:503: 00000100:00100000:1.0:1789445710.518862:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445710.518875:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896bbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789445710.518888:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741979392 00000100:00100000:1.0:1789445710.518891:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741979392 00000100:00100000:1.0:1789445710.518907:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789445710.518912:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:6680:x1876369741979392:12345-0@lo:503: 00000100:00100000:1.0:1789445710.519076:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:6680:x1876369741979392:12345-0@lo:503: Request processed in 162us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445710.519083:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789445710.519120:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741979392:0@lo:503: 00000040:00080000:1.0:1789445710.519418:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789445710.519480:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741979520:0@lo:502: 00000100:00100000:1.0:1789445710.519510:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445710.519526:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896bbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789445710.519540:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741979520 00000100:00100000:1.0:1789445710.519544:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741979520 00000100:00100000:1.0:1789445710.519560:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789445710.519565:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:6680:x1876369741979520:12345-0@lo:502: 00000100:00100000:1.0:1789445710.519713:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:6680:x1876369741979520:12345-0@lo:502: Request processed in 147us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445710.519720:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789445710.519758:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741979520:0@lo:502: 00000040:00080000:1.0:1789445710.519989:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789445710.520036:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789445710.520099:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789445710.520148:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789445710.520186:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789445710.520250:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789445710.520305:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789445710.520342:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789445710.520404:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789445710.520451:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789445710.520486:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789445710.520533:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789445710.520568:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789445710.523292:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789445710.523454:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789445710.523494:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789445710.523527:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789445710.523586:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789445710.523623:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789445710.523657:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789445710.523704:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789445710.523736:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789445710.523768:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789445710.523831:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789445710.523871:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789445710.523921:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789445710.523970:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789445710.524007:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1789445710.524094:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741979648:0@lo:502: 00000100:00100000:1.0:1789445710.524256:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445710.524325:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741979648 00000100:00100000:1.0:1789445710.524335:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741979648 00000100:00100000:1.0:1789445710.524393:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789445710.524405:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:6680:x1876369741979648:12345-0@lo:502: 00000100:00100000:1.0:1789445710.524633:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:6680:x1876369741979648:12345-0@lo:502: Request processed in 232us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445710.524640:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789445710.524698:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896bbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789445710.524723:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741979648:0@lo:502: 00000040:00080000:1.0:1789445710.524791:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789445710.524799:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789445710.525792:0:6704:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789445710.525813:0:6704:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9afe85c3cd40) 00000020:00000080:3.0:1789445710.525838:0:6704:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1789445710.525936:0:6704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afe8533d800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789445710.525941:0:6704:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afe8533d800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789445710.525944:0:6704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afe8533d800 3 00010000:00080000:3.0:1789445710.525978:0:6704:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afebfa4e800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.159@tcp at head 00010000:00010000:1.0:1789445710.529356:0:6704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1789445710.529659:0:6704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789445710.529704:0:6704:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789445710.529720:0:6704:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc1b37c4d47255f17 00000100:00080000:1.0:1789445710.529733:0:6704:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789445710.529755:0:6704:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9afebfa4e800 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:1.0:1789445710.529804:0:6704:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afeb5c78700 x1876369741979776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789445710.529839:0:6704:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789445710.530289:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876369741979904:0@lo:400: 00000100:00100000:1.0:1789445710.530369:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445710.530732:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876369741979776:0@lo:38: 00000100:00100000:3.0:1789445710.530770:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789445710.530956:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:1.0:1789445710.531375:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741979904 00000100:00100000:1.0:1789445710.531385:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741979904 00000100:00100000:1.0:1789445710.531438:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741979776 00000100:00100000:1.0:1789445710.531442:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741979776 00000100:00100000:1.0:1789445710.531457:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789445710.531468:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876369741979904:12345-0@lo:400: 00000100:00100000:1.0:1789445710.531540:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876369741979904:12345-0@lo:400: Request processed in 73us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445710.531547:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789445710.531564:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789445710.531568:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1876369741979776:12345-0@lo:38: 00010000:00080000:1.0:1789445710.531593:0:5842:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:1.0:1789445710.531629:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc1b37c4d47255f1e 00000004:00100000:1.0:1789445710.531647:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789445710.531686:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9afebfa37000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789445710.531733:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876369741979776:12345-0@lo:38: Request processed in 163us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445710.531740:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789445710.531784:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9afe9ee7c380 x1876369741979904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445710.531818:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876369741979904:0@lo:400: 00000020:01000000:1.0:1789445710.531853:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789445710.531889:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789445710.531905:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d47255f02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255f09 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445710.531917:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d47255f02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255f09 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789445710.531966:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789445710.531968:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789445710.531970:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789445710.531971:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789445710.531972:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789445710.531974:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789445710.531975:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789445710.531977:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789445710.531978:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789445710.531981:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789445710.531982:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789445710.531987:0:6680:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789445710.531989:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789445710.531990:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789445710.531992:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789445710.531992:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789445710.531993:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789445710.531994:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789445710.531995:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789445710.531996:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789445710.531997:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789445710.531998:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789445710.531999:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789445710.532020:0:6680:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789445710.532034:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741980032:0@lo:253: 00010000:00080000:3.0:1789445710.532232:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9afeb5c78700 x1876369741979776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789445720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445710.532241:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789445710.532249:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789445710.532263:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789445710.532267:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789445710.532270:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afebfa4e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789445710.532276:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876369741979776:0@lo:38: 00000100:00100000:1.0:1789445710.532432:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445710.532473:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896bb180 going to sleep for 11 seconds 00000100:00100000:3.0:1789445710.532532:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741980032 00000100:00100000:3.0:1789445710.532539:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741980032 00000100:00100000:3.0:1789445710.532619:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789445710.532629:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:6680:x1876369741980032:12345-0@lo:253: 20000000:01000000:3.0:1789445710.532651:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789445710.532667:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1789445710.556182:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1789445710.594426:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789445710.594450:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789445710.595990:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789445710.596003:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789445710.596086:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afe8e988200/0xc1b37c4d47255f25 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.596118:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe8e989c00/0xc1b37c4d47255e7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255e76 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.596127:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afe8e988200/0xc1b37c4d47255f25 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.596182:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe8e989c00/0xc1b37c4d47255e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255e76 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445710.596211:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe8e989c00/0xc1b37c4d47255e7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255e76 expref: 13 pid: 5834 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445710.596249:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876369741980160:0@lo:104: 00000100:00100000:0.0:1789445710.596339:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445710.596410:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91abc480 going to sleep for 11 seconds 00000100:00100000:3.0:1789445710.596731:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741980160 00000100:00100000:3.0:1789445710.596741:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741980160 00000100:00100000:3.0:1789445710.596805:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789445710.596816:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:5856:x1876369741980160:12345-0@lo:104: 00010000:00010000:3.0:1789445710.596832:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe81504400/0xc1b37c4d47255e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255e7d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.596910:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789445710.596916:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:5856:x1876369741980160:12345-0@lo:104: Request processed in 103us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445710.596923:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789445710.596968:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789445710.596974:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81504400/0xc1b37c4d47255e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255e7d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.596981:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81504400 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:3.0:1789445710.596994:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81504400/0xc1b37c4d47255e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255e7d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.597013:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81504400/0xc1b37c4d47255e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255e7d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789445710.597022:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81504400/0xc1b37c4d47255e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255e7d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789445710.597028:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789445710.597083:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe81504400/0xc1b37c4d47255e76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255e7d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.597090:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789445710.597224:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81504400/0xc1b37c4d47255e76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255e7d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.597232:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81504400/0xc1b37c4d47255e76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255e7d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.597253:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445710.597255:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445710.597256:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445710.597283:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369741980288:0@lo:103: 00000100:00100000:3.0:1789445710.597322:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445710.597383:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741980288 00000100:00100000:3.0:1789445710.597389:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741980288 00010000:00010000:3.0:1789445710.597410:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe8e989c00/0xc1b37c4d47255e7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255e76 expref: 14 pid: 5834 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445710.597432:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789445710.597446:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe919b3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:3310:x1876369741980288:12345-0@lo:103: 00010000:00010000:3.0:1789445710.597459:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445710.597465:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe8e989c00/0xc1b37c4d47255e7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255e76 expref: 14 pid: 5834 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.597476:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe8e989c00/0xc1b37c4d47255e7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255e76 expref: 14 pid: 5834 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.597497:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afe8e988200/0xc1b37c4d47255f25 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.597506:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe8e988200/0xc1b37c4d47255f25 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789445710.597521:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001519425s 00010000:00010000:3.0:1789445710.597526:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afe8e988200/0xc1b37c4d47255f25 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.597534:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afe8e988200/0xc1b37c4d47255f25 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.597540:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afe8e988200/0xc1b37c4d47255f25 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.597546:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afe8e988200/0xc1b37c4d47255f25 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.597552:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988200 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445710.597556:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afe8e988200/0xc1b37c4d47255f25 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.597678:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afe8e988200/0xc1b37c4d47255f25 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.597694:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afe8e988200/0xc1b37c4d47255f25 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445710.597705:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445710.597750:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe919b3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:3310:x1876369741980288:12345-0@lo:103: Request processed in 305us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445710.597757:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789445710.599955:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe8e989c00/0xc1b37c4d47255e7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255e76 expref: 13 pid: 5834 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445710.599983:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876369741980160:0@lo:104: 00010000:00010000:2.0:1789445710.600297:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afe8e988200/0xc1b37c4d47255f25 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445710.600310:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afe8e988200/0xc1b37c4d47255f25 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445710.600316:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afe8e988200/0xc1b37c4d47255f25 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445710.600322:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe8e988200/0xc1b37c4d47255f25 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445710.600674:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369741980288:0@lo:103: 00000100:00100000:2.0:1789445710.618088:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:6680:x1876369741980032:12345-0@lo:253: Request processed in 85410us (85924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445710.618236:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:6680:1876369741980032:0@lo:253: 10000000:01000000:1.0:1789445710.618255:0:6680:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789445710.618261:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789445710.618263:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789445710.618265:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789445710.618266:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789445710.618268:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789445710.618269:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789445710.618270:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789445710.618272:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789445710.618273:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789445710.618275:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789445710.618276:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789445710.618297:0:6680:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789445710.618534:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00080000:10000000:0.0:1789445710.635336:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789445710.635740:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789445710.636340:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789445710.636648:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789445710.637251:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789445710.637699:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789445710.639941:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789445710.898270:0:6680:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789445710.898279:0:6680:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789445710.898313:0:6680:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789445710.898367:0:6680:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.159@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789445710.898380:0:6680:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789445710.898409:0:6680:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789445711.579187:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445712.612308:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445713.627300:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445714.650701:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445715.546864:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369741980544:0@lo:400: 00000100:00100000:3.0:1789445715.546935:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445715.546990:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789445715.546996:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369741980672:0@lo:400: 00000100:00100000:3.0:1789445715.547018:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445715.547093:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741980544 00000100:00100000:3.0:1789445715.547101:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741980544 00000100:00100000:3.0:1789445715.547140:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741980672 00000100:00100000:3.0:1789445715.547143:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741980672 00000100:00100000:3.0:1789445715.547167:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789445715.547189:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369741980544:12345-0@lo:400: 00000100:00100000:3.0:1789445715.547241:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369741980544:12345-0@lo:400: Request processed in 65us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445715.547248:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789445715.547264:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789445715.547281:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369741980672:12345-0@lo:400: 00000100:00100000:3.0:1789445715.547308:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369741980672:12345-0@lo:400: Request processed in 29us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445715.547312:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789445715.547355:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afeadb9bb80 x1876369741980672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445715.547368:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369741980672:0@lo:400: 00010000:00080000:3.0:1789445715.547379:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afeadb9a680 x1876369741980544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445715.547386:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369741980544:0@lo:400: 00000100:00100000:0.0:1789445715.547513:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741980416:0@lo:400: 00000100:00100000:0.0:1789445715.547547:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789445715.547589:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445715.547859:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741980416 00000100:00100000:3.0:1789445715.547865:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741980416 00000100:00100000:3.0:1789445715.547900:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789445715.547908:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:3311:x1876369741980416:12345-0@lo:400: 00000100:00100000:3.0:1789445715.547954:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:3311:x1876369741980416:12345-0@lo:400: Request processed in 47us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445715.547960:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789445715.550199:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741980416:0@lo:400: 00010000:00010000:3.0:1789445715.680816:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445716.698667:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789445717.293018:0:7047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg659-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1789445717.596300:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789445717.596311:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afe9d560800 from 21 10000000:01000000:3.0:1789445717.596317:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789445717.596373:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47255f2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.596387:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47255f2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.596413:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47255f2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445717.596443:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741980800:0@lo:101: 00000100:00100000:3.0:1789445717.596531:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445717.596610:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91474240 going to sleep for 11 seconds 00000100:00100000:2.0:1789445717.596723:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741980800 00000100:00100000:2.0:1789445717.596733:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741980800 00000100:00100000:2.0:1789445717.596799:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789445717.596809:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5838:x1876369741980800:12345-0@lo:101: 00010000:00010000:2.0:1789445717.596824:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445717.596839:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255f33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255f2c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445717.596878:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255f33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255f2c expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445717.596890:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255f33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255f2c expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445717.596901:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81505400, rc 0) 00000100:00100000:2.0:1789445717.596956:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:5838:x1876369741980800:12345-0@lo:101: Request processed in 148us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445717.596963:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789445717.597020:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741980800:0@lo:101: 00010000:00010000:2.0:1789445717.597036:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47255f2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255f33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445717.597071:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47255f2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255f33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445717.597140:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741980928:0@lo:501: 00000100:00100000:2.0:1789445717.597184:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445717.597202:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4d07f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789445717.597217:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741980928 00000100:00100000:2.0:1789445717.597222:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741980928 00000100:00100000:2.0:1789445717.597243:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789445717.597250:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:5838:x1876369741980928:12345-0@lo:501: 00000100:00100000:2.0:1789445717.597771:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:5838:x1876369741980928:12345-0@lo:501: Request processed in 520us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445717.597780:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789445717.597824:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741980928:0@lo:501: 00000100:00100000:2.0:1789445717.597855:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741981056:0@lo:503: 00000100:00100000:2.0:1789445717.597892:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445717.597905:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4d07f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789445717.597916:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741981056 00000100:00100000:2.0:1789445717.597921:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741981056 00000100:00100000:2.0:1789445717.597940:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789445717.597947:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:5838:x1876369741981056:12345-0@lo:503: 00000100:00100000:2.0:1789445717.598269:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:5838:x1876369741981056:12345-0@lo:503: Request processed in 321us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445717.598276:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789445717.598308:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741981056:0@lo:503: 00000100:00100000:2.0:1789445717.598537:0:7061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7061:1876369741981184:0@lo:502: 00000100:00100000:2.0:1789445717.602025:0:7061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445717.602107:0:7061:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4d079c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445717.602781:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741981184 00000100:00100000:3.0:1789445717.602795:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741981184 00000100:00100000:3.0:1789445717.602870:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789445717.602881:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7061:x1876369741981184:12345-0@lo:502: 00000100:00100000:3.0:1789445717.603339:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7061:x1876369741981184:12345-0@lo:502: Request processed in 445us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445717.603348:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789445717.604482:0:7061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7061:1876369741981184:0@lo:502: 00000100:00100000:2.0:1789445717.604591:0:7061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7061:1876369741981312:0@lo:502: 00000100:00100000:2.0:1789445717.604661:0:7061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445717.604708:0:7061:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4d079c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445717.605133:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741981312 00000100:00100000:3.0:1789445717.605144:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741981312 00000100:00100000:3.0:1789445717.605212:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789445717.605223:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7061:x1876369741981312:12345-0@lo:502: 00000100:00100000:3.0:1789445717.605511:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7061:x1876369741981312:12345-0@lo:502: Request processed in 289us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445717.605519:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789445717.606476:0:7061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7061:1876369741981312:0@lo:502: 00000040:00080000:2.0:1789445717.606528:0:7061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1789445717.606774:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1789445717.606799:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789445717.606812:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47255f2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255f33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.606825:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47255f2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255f33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789445717.606848:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789445717.606850:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afe9d560800 from 4 10000000:01000000:3.0:1789445717.606853:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789445717.606898:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe813fc600/0xc1b37c4d47255f3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.606906:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe813fc600/0xc1b37c4d47255f3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.606915:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe813fc600/0xc1b37c4d47255f3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445717.606935:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741981440:0@lo:101: 00000100:00100000:3.0:1789445717.606990:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445717.607035:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91474840 going to sleep for 11 seconds 00000100:00100000:2.0:1789445717.607273:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741981440 00000100:00100000:2.0:1789445717.607281:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741981440 00000100:00100000:2.0:1789445717.607337:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789445717.607347:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:5838:x1876369741981440:12345-0@lo:101: 00010000:00010000:2.0:1789445717.607369:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445717.607386:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81505e00/0xc1b37c4d47255f41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255f3a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445717.607414:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81505e00/0xc1b37c4d47255f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255f3a expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445717.607426:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81505e00/0xc1b37c4d47255f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255f3a expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445717.607436:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81505e00, rc 0) 00000100:00100000:2.0:1789445717.607478:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:5838:x1876369741981440:12345-0@lo:101: Request processed in 133us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445717.607485:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789445717.613392:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741981440:0@lo:101: 00010000:00010000:3.0:1789445717.613431:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe813fc600/0xc1b37c4d47255f3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255f41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.613447:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe813fc600/0xc1b37c4d47255f3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255f41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445717.613531:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741981568:0@lo:256: 00000100:00100000:3.0:1789445717.613613:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445717.613669:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91474840 going to sleep for 11 seconds 00000100:00100000:3.0:1789445717.613691:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741981568 00000100:00100000:3.0:1789445717.613699:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741981568 00000100:00100000:3.0:1789445717.613760:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789445717.613777:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:5838:x1876369741981568:12345-0@lo:256: 20000000:01000000:3.0:1789445717.613803:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789445717.613821:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789445717.613824:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789445717.613917:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:5838:x1876369741981568:12345-0@lo:256: Request processed in 141us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445717.613926:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789445717.613967:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741981568:0@lo:256: 10000000:01000000:3.0:1789445717.614011:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789445717.614020:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe813fc600/0xc1b37c4d47255f3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255f41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.614029:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe813fc600/0xc1b37c4d47255f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255f41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789445717.614039:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789445717.614066:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789445717.614069:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789445717.614097:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe813fde00/0xc1b37c4d47255f48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.614105:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe813fde00/0xc1b37c4d47255f48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.614115:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe813fde00/0xc1b37c4d47255f48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445717.614129:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741981696:0@lo:101: 00000100:00100000:3.0:1789445717.614157:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445717.614201:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91474840 going to sleep for 11 seconds 00000100:00100000:3.0:1789445717.614215:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741981696 00000100:00100000:3.0:1789445717.614220:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741981696 00000100:00100000:3.0:1789445717.614244:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789445717.614251:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:5838:x1876369741981696:12345-0@lo:101: 00010000:00010000:3.0:1789445717.614260:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445717.614273:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255f4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255f48 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.614294:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255f4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255f48 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.614304:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255f4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255f48 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.614314:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fc000, rc 0) 00000100:00100000:3.0:1789445717.614342:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369741981696:12345-0@lo:101: Request processed in 92us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445717.614347:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789445717.614378:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741981696:0@lo:101: 00010000:00010000:3.0:1789445717.614390:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe813fde00/0xc1b37c4d47255f48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255f4f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.614399:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe813fde00/0xc1b37c4d47255f48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255f4f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445717.614447:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741981824:0@lo:501: 00000100:00100000:3.0:1789445717.614469:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445717.614482:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91474840 going to sleep for 11 seconds 00000100:00100000:3.0:1789445717.614497:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741981824 00000100:00100000:3.0:1789445717.614501:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741981824 00000100:00100000:3.0:1789445717.614521:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789445717.614526:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369741981824:12345-0@lo:501: 00000100:00100000:3.0:1789445717.614804:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369741981824:12345-0@lo:501: Request processed in 276us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445717.614811:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789445717.614840:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741981824:0@lo:501: 00000100:00100000:3.0:1789445717.614864:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741981952:0@lo:503: 00000100:00100000:3.0:1789445717.614901:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445717.614914:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91474840 going to sleep for 11 seconds 00000100:00100000:3.0:1789445717.614925:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741981952 00000100:00100000:3.0:1789445717.614929:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741981952 00000100:00100000:3.0:1789445717.614948:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789445717.614954:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369741981952:12345-0@lo:503: 00000100:00100000:3.0:1789445717.615300:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369741981952:12345-0@lo:503: Request processed in 344us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445717.615308:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789445717.615348:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741981952:0@lo:503: 00000100:00100000:1.0:1789445717.623905:0:7063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7063:1876369741982080:0@lo:502: 00000100:00100000:1.0:1789445717.624011:0:7063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445717.624085:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741982080 00000100:00100000:1.0:1789445717.624094:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741982080 00000100:00100000:2.0:1789445717.625196:0:7063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d538d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789445717.629362:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789445717.629387:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:7063:x1876369741982080:12345-0@lo:502: 00000100:00100000:1.0:1789445717.632529:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:7063:x1876369741982080:12345-0@lo:502: Request processed in 3121us (8487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445717.632548:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789445717.635889:0:7063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7063:1876369741982080:0@lo:502: 00000020:01000000:2.0:1789445717.635950:0:7063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789445717.635960:0:7063:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789445717.635969:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445717.635971:0:7063:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789445717.635978:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789445717.635983:0:7063:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.159@tcp to nid 0x20000c0a8ce9f (192.168.206.159@tcp) 00000020:01000000:2.0:1789445717.636014:0:7063:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789445717.636018:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789445717.636071:0:7063:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9afeba50b380) 00000020:00000080:2.0:1789445717.636098:0:7063:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1789445717.636106:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789445717.636222:0:7063:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789445717.636230:0:7063:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789445717.636246:0:7063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1b37c4d47255f5d 00010000:00080000:2.0:1789445717.636296:0:7063:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afeb536e800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.159@tcp at head 00010000:00010000:2.0:1789445717.636567:0:7063:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:2.0:1789445717.722591:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789445717.735479:0:7063:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789445717.735514:0:7063:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789445717.736393:0:7063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789445717.736735:0:7063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789445717.736794:0:7063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789445717.736859:0:7063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789445717.737636:0:7070:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789445717.737642:0:7070:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789445717.739424:0:7063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789445717.739445:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789445717.739492:0:7063:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789445717.739519:0:7063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1b37c4d47255f64 00000100:00080000:0.0:1789445717.739608:0:7063:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789445717.739624:0:7063:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9afeb536e800 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:0.0:1789445717.739673:0:7063:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afe9ee7e300 x1876369741982208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789445717.739738:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369741982208:0@lo:8: 00000100:00100000:1.0:1789445717.739825:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789445717.739880:0:7063:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789445717.739944:0:7063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789445717.739948:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789445717.739956:0:7063:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789445717.739960:0:7063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789445717.739964:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789445717.739965:0:7063:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789445717.739968:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789445717.739970:0:7063:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789445717.740115:0:7063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7063:1876369741982336:0@lo:502: 00000100:00100000:0.0:1789445717.740160:0:7063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445717.740221:0:7063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb5485a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789445717.740390:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741982208 00000100:00100000:2.0:1789445717.740399:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741982208 00000100:00100000:2.0:1789445717.740439:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789445717.740447:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876369741982208:12345-0@lo:8: 00010000:00080000:2.0:1789445717.740474:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:2.0:1789445717.740502:0:6682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1b37c4d47255f6b 00002000:00100000:2.0:1789445717.740606:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9afeb536b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789445717.740612:0:6682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1789445717.740616:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789445717.740759:0:6682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789445717.740913:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789445717.740940:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9afeb5369000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789445717.741097:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876369741982208:12345-0@lo:8: Request processed in 649us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445717.741106:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789445717.741415:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afe9ee7e300 x1876369741982208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789445727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445717.741428:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789445717.741439:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789445717.741449:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789445717.741454:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789445717.741457:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afeb536e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789445717.741511:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789445717.741518:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369741982208:0@lo:8: 00000100:00100000:1.0:1789445717.741633:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741982336 00000100:00100000:1.0:1789445717.741640:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741982336 00000100:00100000:1.0:1789445717.741680:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789445717.741689:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:7063:x1876369741982336:12345-0@lo:502: 00000100:00100000:1.0:1789445717.742160:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:7063:x1876369741982336:12345-0@lo:502: Request processed in 470us (1996us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445717.742185:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789445717.742391:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369741982464:0@lo:400: 00000100:00100000:1.0:1789445717.742437:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445717.742465:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789445717.742471:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369741982592:0@lo:400: 00000100:00100000:1.0:1789445717.742498:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445717.742553:0:7063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7063:1876369741982336:0@lo:502: 00000020:01000000:1.0:1789445717.742590:0:7063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445717.742599:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445717.742609:0:7063:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789445717.742614:0:7063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000004:00080000:1.0:1789445717.742746:0:7070:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789445717.742898:0:7070:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 155764852605ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789445717.743677:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741982464 00000100:00100000:3.0:1789445717.743690:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741982464 00000100:00100000:3.0:1789445717.743735:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741982592 00000100:00100000:3.0:1789445717.743739:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741982592 00000100:00100000:3.0:1789445717.743770:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789445717.743780:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369741982464:12345-0@lo:400: 00000100:00100000:3.0:1789445717.743872:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369741982464:12345-0@lo:400: Request processed in 93us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445717.743891:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789445717.743910:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789445717.743916:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369741982592:12345-0@lo:400: 00000100:00100000:3.0:1789445717.743948:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369741982592:12345-0@lo:400: Request processed in 32us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445717.743954:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000000:3.0:1789445717.743975:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1789445717.743999:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789445717.744011:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe813fde00/0xc1b37c4d47255f48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255f4f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.744025:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe813fde00/0xc1b37c4d47255f48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255f4f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789445717.744036:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789445717.744040:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9afea4f94d40 from 1 10000000:01000000:3.0:1789445717.744058:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789445717.744100:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe813fcc00/0xc1b37c4d47255f72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.744109:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe813fcc00/0xc1b37c4d47255f72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.744119:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe813fcc00/0xc1b37c4d47255f72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445717.744138:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741982720:0@lo:101: 00000100:00100000:3.0:1789445717.744192:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445717.744232:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91474840 going to sleep for 11 seconds 00000100:00080000:3.0:1789445717.744249:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789445717.744283:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afeb5c78000 x1876369741982592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445717.744298:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369741982592:0@lo:400: 00010000:00080000:3.0:1789445717.744310:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afeb5c79500 x1876369741982464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445717.744318:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369741982464:0@lo:400: 00000100:00100000:3.0:1789445717.744349:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741982720 00000100:00100000:3.0:1789445717.744353:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741982720 00000100:00100000:3.0:1789445717.744388:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789445717.744396:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369741982720:12345-0@lo:101: 00010000:00010000:3.0:1789445717.744406:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445717.744431:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe813fce00/0xc1b37c4d47255f79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255f72 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.744462:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe813fce00/0xc1b37c4d47255f79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255f72 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.744473:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe813fce00/0xc1b37c4d47255f79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255f72 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.744482:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fce00, rc 0) 00000100:00100000:3.0:1789445717.744512:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369741982720:12345-0@lo:101: Request processed in 116us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445717.744519:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789445717.744555:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741982720:0@lo:101: 00010000:00010000:3.0:1789445717.744579:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe813fcc00/0xc1b37c4d47255f72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255f79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445717.744589:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe813fcc00/0xc1b37c4d47255f72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255f79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445717.744650:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741982848:0@lo:501: 00000100:00100000:3.0:1789445717.744675:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445717.744690:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91474840 going to sleep for 11 seconds 00000100:00100000:3.0:1789445717.744704:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741982848 00000100:00100000:3.0:1789445717.744707:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741982848 00000100:00100000:3.0:1789445717.744726:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789445717.744732:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369741982848:12345-0@lo:501: 00000100:00100000:3.0:1789445717.744960:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369741982848:12345-0@lo:501: Request processed in 226us (283us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789445717.744967:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789445717.745095:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741982848:0@lo:501: 10000000:01000000:0.0:1789445717.745120:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789445717.745127:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe813fcc00/0xc1b37c4d47255f72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255f79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445717.745136:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe813fcc00/0xc1b37c4d47255f72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255f79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789445717.796235:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789445717.849587:0:7071:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789445717.849640:0:7071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7071:1876369741983104:0@lo:7: 00000100:00100000:2.0:1789445717.849741:0:7071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445717.849830:0:7071:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4ebe600 going to sleep for 11 seconds 00000100:00100000:2.0:1789445717.849881:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741983104 00000100:00100000:2.0:1789445717.849890:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741983104 00000100:00100000:2.0:1789445717.849959:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789445717.850114:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789445717.850126:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369741982976:0@lo:13: 00000100:00100000:0.0:1789445717.850186:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445717.850456:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7071:x1876369741983104:12345-0@lo:7: 00000100:00100000:3.0:1789445717.854449:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741982976 00000100:00100000:3.0:1789445717.854469:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741982976 00000100:00100000:3.0:1789445717.854548:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789445717.854562:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876369741982976:12345-0@lo:13: 00002000:00000024:3.0:1789445717.854607:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789445717.854716:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876369741982976:12345-0@lo:13: Request processed in 157us (4529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445717.854723:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789445717.854756:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789445717.854805:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afea4d42680 x1876369741982976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445717.854830:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369741982976:0@lo:13: 00002000:00080000:3.0:1789445717.868957:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789445717.868968:0:6685:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789445717.869334:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7071:x1876369741983104:12345-0@lo:7: Request processed in 19356us (19583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445717.869354:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789445717.869464:0:7071:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afea4d40000 x1876369741983104/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789445733 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445717.869482:0:7071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7071:1876369741983104:0@lo:7: 00000004:00080000:2.0:1789445717.869501:0:7071:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789445717.869551:0:7071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7071:1876369741983232:0@lo:5: 00000100:00100000:2.0:1789445717.869593:0:7071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445717.869694:0:7071:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8513f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445717.869747:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741983232 00000100:00100000:0.0:1789445717.869757:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741983232 00000100:00100000:0.0:1789445717.869847:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789445717.869858:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7071:x1876369741983232:12345-0@lo:5: 00002000:00080000:0.0:1789445717.869889:0:6684:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789445717.869893:0:6684:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789445717.870395:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7071:x1876369741983232:12345-0@lo:5: Request processed in 537us (800us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789445717.870426:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789445717.870494:0:7071:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afea4d40000 x1876369741983232/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789445733 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445717.870508:0:7071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7071:1876369741983232:0@lo:5: 00000004:00080000:2.0:1789445717.870518:0:7071:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789445717.870553:0:7071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7071:1876369741983360:0@lo:700: 00000100:00100000:2.0:1789445717.870585:0:7071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445717.870613:0:7071:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8513f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445717.870697:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741983360 00000100:00100000:1.0:1789445717.870704:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741983360 00000100:00100000:1.0:1789445717.870740:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789445717.870749:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7071:x1876369741983360:12345-0@lo:700: 00000100:00100000:1.0:1789445717.870784:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6691:1876369741983488:0@lo:700: 00000100:00100000:1.0:1789445717.870817:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445717.870838:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d538600 going to sleep for 11 seconds 00000100:00100000:1.0:1789445717.870859:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741983488 00000100:00100000:1.0:1789445717.870862:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741983488 00000100:00100000:1.0:1789445717.870891:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789445717.870898:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6691:x1876369741983488:12345-0@lo:700: 40000000:02000000:1.0:1789445717.977445:0:5847:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1789445717.993553:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6691:x1876369741983488:12345-0@lo:700: Request processed in 122641us (122720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445717.993575:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789445717.993709:0:6691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afeb5c79500 x1876369741983488/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789445733 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445717.993729:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6691:1876369741983488:0@lo:700: 40000000:02000000:3.0:1789445717.993748:0:6691:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1789445718.085317:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7071:x1876369741983360:12345-0@lo:700: Request processed in 214557us (214718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445718.085439:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:0.0:1789445718.085568:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1789445718.085581:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1789445718.085650:0:7071:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afea4d42680 x1876369741983360/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789445733 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445718.085671:0:7071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7071:1876369741983360:0@lo:700: 00000004:02000040:0.0:1789445718.172872:0:7071:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1789445718.184751:0:7071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7071:1876369741983616:0@lo:5: 00000100:00100000:0.0:1789445718.184851:0:7071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445718.184978:0:7071:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8513f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445718.191400:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741983616 00000100:00100000:3.0:1789445718.191423:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741983616 00000100:00100000:3.0:1789445718.191497:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789445718.191510:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7071:x1876369741983616:12345-0@lo:5: 00002000:00080000:2.0:1789445718.205229:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789445718.205256:0:6685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1789445718.215279:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7071:x1876369741983616:12345-0@lo:5: Request processed in 23761us (30416us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789445718.215296:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789445718.215538:0:7071:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afe9ee7d180 x1876369741983616/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789445734 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445718.215554:0:7071:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789445718.215572:0:7071:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9afe9ee7d180 x1876369741983616/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789445734 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445718.215585:0:7071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7071:1876369741983616:0@lo:5: 00000004:00080000:0.0:1789445718.215603:0:7071:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1789445718.748273:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445719.770653:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445720.795431:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445721.818574:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789445722.834757:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1789445722.842228:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445723.228428:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369741983744:0@lo:13: 00000100:00100000:3.0:1789445723.228500:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445723.228642:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876369741984000:0@lo:400: 00000100:00100000:3.0:1789445723.228669:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445723.228685:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789445723.228690:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741983872:0@lo:400: 00000100:00100000:3.0:1789445723.228714:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445723.228740:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741984000 00000100:00100000:3.0:1789445723.228747:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741984000 00000100:00100000:3.0:1789445723.229010:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789445723.229032:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876369741984000:12345-0@lo:400: 00000100:00100000:3.0:1789445723.229105:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876369741984000:12345-0@lo:400: Request processed in 76us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445723.229112:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789445723.229134:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741983872 00000100:00100000:3.0:1789445723.229149:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741983872 00000100:00100000:3.0:1789445723.229174:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789445723.229180:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:3311:x1876369741983872:12345-0@lo:400: 00000100:00100000:3.0:1789445723.229210:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:3311:x1876369741983872:12345-0@lo:400: Request processed in 30us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445723.229216:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789445723.229254:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369741984128:0@lo:400: 00000100:00100000:3.0:1789445723.229278:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445723.229307:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741984128 00000100:00100000:3.0:1789445723.229311:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741984128 00000100:00100000:3.0:1789445723.229340:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789445723.229346:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369741984128:12345-0@lo:400: 00000100:00100000:3.0:1789445723.229376:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369741984128:12345-0@lo:400: Request processed in 31us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445723.229382:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789445723.229398:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789445723.229423:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afeadb99f80 x1876369741984128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445723.229436:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369741984128:0@lo:400: 00000100:00100000:3.0:1789445723.229462:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741983872:0@lo:400: 00010000:00080000:3.0:1789445723.229471:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afeadb9b800 x1876369741984000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445723.229486:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876369741984000:0@lo:400: 00000100:00100000:0.0:1789445723.239029:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741983744 00000100:00100000:0.0:1789445723.239061:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741983744 00000100:00100000:0.0:1789445723.239987:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789445723.240009:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369741983744:12345-0@lo:13: 00002000:00000024:0.0:1789445723.240063:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789445723.241374:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789445723.241812:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369741983744:12345-0@lo:13: Request processed in 1803us (13310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445723.241822:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789445723.242719:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afe9ee7d500 x1876369741983744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445723.242731:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789445723.242757:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369741983744:0@lo:13: 00010000:00010000:3.0:1789445723.870209:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445724.891640:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445725.925306:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445726.938811:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445727.967216:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445728.346386:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789445728.346411:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369741984256:0@lo:13: 00000100:00100000:0.0:1789445728.346486:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445728.346553:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741984256 00000100:00100000:0.0:1789445728.346560:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741984256 00000100:00100000:0.0:1789445728.346610:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789445728.346619:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369741984256:12345-0@lo:13: 00002000:00000024:0.0:1789445728.346651:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789445728.346695:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369741984256:12345-0@lo:13: Request processed in 77us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445728.346702:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789445728.346720:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789445728.346749:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afe9ee7c000 x1876369741984256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445728.346766:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369741984256:0@lo:13: 00000100:00100000:0.0:1789445728.350388:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369741984384:0@lo:400: 00000100:00100000:0.0:1789445728.350470:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445728.350513:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789445728.350519:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369741984512:0@lo:400: 00000100:00100000:0.0:1789445728.350548:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445728.350598:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741984384 00000100:00100000:0.0:1789445728.350606:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741984384 00000100:00100000:0.0:1789445728.350648:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789445728.350656:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:3310:x1876369741984384:12345-0@lo:400: 00000100:00100000:0.0:1789445728.350702:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:3310:x1876369741984384:12345-0@lo:400: Request processed in 46us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445728.350708:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789445728.350741:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741984512 00000100:00100000:0.0:1789445728.350744:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741984512 00000100:00100000:0.0:1789445728.350769:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789445728.350775:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369741984512:12345-0@lo:400: 00000100:00100000:0.0:1789445728.350806:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369741984512:12345-0@lo:400: Request processed in 30us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445728.350812:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789445728.350833:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789445728.350841:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369741984640:0@lo:400: 00000100:00100000:0.0:1789445728.350869:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445728.350893:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741984640 00000100:00100000:0.0:1789445728.350897:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741984640 00000100:00100000:0.0:1789445728.350939:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789445728.350946:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369741984640:12345-0@lo:400: 00000100:00100000:0.0:1789445728.350979:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369741984640:12345-0@lo:400: Request processed in 33us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445728.350985:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789445728.351000:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789445728.351026:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afe9ee7d500 x1876369741984640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445728.351038:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369741984640:0@lo:400: 00010000:00080000:0.0:1789445728.351096:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afe9ee7dc00 x1876369741984512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445728.351105:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369741984512:0@lo:400: 00000100:00100000:0.0:1789445728.351128:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369741984384:0@lo:400: 00010000:00010000:3.0:1789445728.986228:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789445729.447453:0:7620:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789445729.447457:0:7620:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789445729.447597:0:7620:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9afebb4dd000 00000020:01000004:1.0:1789445729.447612:0:7620:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789445729.447629:0:7620:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789445729.447648:0:7620:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9afeb57c0000) 00000020:00000080:1.0:1789445729.447663:0:7620:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789445729.470836:0:7620:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789445729.471189:0:7620:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789445729.493452:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789445729.506800:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789445729.506833:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789445729.506891:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789445729.507377:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789445729.507700:0:7620:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789445729.507711:0:7620:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789445729.507721:0:7620:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc1b37c4d47255f87 00000020:01000004:1.0:1789445729.507730:0:7620:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1789445729.507751:0:7620:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.159@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789445729.507754:0:7620:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789445729.507759:0:7620:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789445729.507781:0:7620:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1789445729.507785:0:7620:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.159@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789445729.533420:0:7620:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.159@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789445729.533457:0:7620:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.159@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789445729.533463:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789445729.533464:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789445729.533466:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789445729.533467:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789445729.533468:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789445729.533469:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789445729.533471:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789445729.533472:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789445729.533473:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789445729.533474:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789445729.533476:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789445729.533478:0:7620:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789445729.533480:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789445729.533482:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789445729.533483:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789445729.533484:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789445729.533484:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789445729.533485:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789445729.533486:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789445729.533487:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789445729.533488:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789445729.533489:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789445729.533490:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789445729.533521:0:7620:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789445729.533538:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741984768:0@lo:253: 00000100:00100000:2.0:1789445729.533609:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445729.533737:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789445729.533820:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741984768 00000100:00100000:3.0:1789445729.533828:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741984768 00000100:00100000:3.0:1789445729.533948:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789445729.533957:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:7620:x1876369741984768:12345-0@lo:253: 20000000:01000000:3.0:1789445729.533996:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789445729.534001:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789445729.534005:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789445729.534008:0:5835:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789445729.534983:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789445729.535253:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789445729.535269:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789445729.535308:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789445729.535317:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789445729.535348:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789445729.535393:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789445729.535757:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789445729.535777:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.159@tcp 20000000:01000000:3.0:1789445729.535780:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.159@tcp (null) (null) (null) 00000040:00080000:3.0:1789445729.535810:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789445729.535818:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789445729.535861:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789445729.535869:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.159@tcp (null) (null) 00000040:00080000:3.0:1789445729.535911:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789445729.535920:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789445729.535950:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789445729.535998:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789445729.537552:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1789445729.537583:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.159@tcp 20000000:01000000:3.0:1789445729.537585:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.159@tcp (null) (null) (null) 00000040:00080000:3.0:1789445729.537636:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1789445729.537644:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789445729.537671:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1789445729.537677:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.159@tcp (null) (null) 00000040:00080000:3.0:1789445729.537702:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1789445729.537709:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789445729.537777:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1789445729.537816:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1789445729.537836:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1789445729.537838:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1789445729.537844:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789445729.537846:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789445729.537848:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789445729.537860:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789445729.537863:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789445729.537900:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789445729.537903:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789445729.538589:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789445729.538858:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789445729.538900:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789445729.539160:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789445729.539176:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789445729.539178:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789445729.539704:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789445729.539755:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789445729.539809:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789445729.540296:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789445729.540422:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789445729.540505:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789445729.540526:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789445729.540528:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789445729.541236:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1789445729.541282:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1789445729.541332:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789445729.541665:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1789445729.541707:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1789445729.541742:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1789445729.541757:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789445729.541759:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789445729.542590:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1789445729.542648:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1789445729.542675:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1789445729.543004:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1789445729.543250:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1789445729.543313:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:3.0:1789445729.543411:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789445729.543432:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255f8e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.543450:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255ed8 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.543458:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe81679200/0xc1b37c4d47255f09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255f02 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.543465:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255f33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255f2c expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.543472:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255f4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255f48 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.543478:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe813fce00/0xc1b37c4d47255f79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255f72 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.543485:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255f8e lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.543521:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe813fce00/0xc1b37c4d47255f79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255f72 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.543545:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe813fce00/0xc1b37c4d47255f79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255f72 expref: 16 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445729.543559:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1876369741984896:0@lo:104: 00000100:00100000:3.0:1789445729.543620:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789445729.543712:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255f4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255f48 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.543720:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255f4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255f48 expref: 16 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445729.543729:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1876369741985024:0@lo:104: 00010000:00010000:3.0:1789445729.543754:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255f33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255f2c expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.543761:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255f33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255f2c expref: 16 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445729.543769:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb99f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1876369741985152:0@lo:104: 00010000:00010000:3.0:1789445729.543790:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe81679200/0xc1b37c4d47255f09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255f02 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.543797:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe81679200/0xc1b37c4d47255f09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255f02 expref: 16 pid: 5834 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445729.543804:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1876369741985280:0@lo:104: 00010000:00010000:3.0:1789445729.543825:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255edf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255ed8 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.543843:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255edf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255ed8 expref: 16 pid: 5836 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445729.543851:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb99180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1876369741985408:0@lo:104: 00000100:00100000:3.0:1789445729.543870:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445729.544213:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789445729.544233:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445729.544300:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445729.544367:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445729.544432:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741984896 00000100:00100000:3.0:1789445729.544439:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741984896 00000100:00100000:3.0:1789445729.544472:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741985024 00000100:00100000:3.0:1789445729.544475:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741985024 00000100:00100000:3.0:1789445729.544484:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741985152 00000100:00100000:3.0:1789445729.544486:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741985152 00000100:00100000:3.0:1789445729.544497:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789445729.544503:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91903450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:5835:x1876369741984896:12345-0@lo:104: 00010000:00010000:3.0:1789445729.544515:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe813fcc00/0xc1b37c4d47255f72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255f79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445729.544662:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1876369741984896:0@lo:104: 00010000:00010000:3.0:1789445729.544698:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789445729.544706:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91903450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:5835:x1876369741984896:12345-0@lo:104: Request processed in 202us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445729.544713:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789445729.544750:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789445729.544757:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+4:5835:x1876369741985024:12345-0@lo:104: 00010000:00010000:3.0:1789445729.544764:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe813fde00/0xc1b37c4d47255f48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255f4f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445729.544841:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1876369741985024:0@lo:104: 00000100:00100000:0.0:1789445729.544887:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445729.544895:0:5824:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789445729.544901:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1789445729.545281:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741985280 00000100:00100000:1.0:1789445729.545286:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741985280 00000100:00100000:1.0:1789445729.545312:0:5824:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789445729.545318:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741985408 00000100:00100000:1.0:1789445729.545320:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741985408 00000100:00100000:0.0:1789445729.545552:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789445729.545561:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+6:5835:x1876369741985152:12345-0@lo:104: 00010000:00010000:0.0:1789445729.545570:0:7626:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47255f2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255f33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445729.545661:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb99f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1876369741985152:0@lo:104: 00010000:00010000:2.0:1789445729.546134:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789445729.546143:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe813fcc00/0xc1b37c4d47255f72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255f79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.546160:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fcc00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1789445729.546164:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe813fcc00/0xc1b37c4d47255f72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255f79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.546172:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe813fcc00/0xc1b37c4d47255f72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255f79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789445729.546190:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe813fcc00/0xc1b37c4d47255f72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255f79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445729.546196:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789445729.546239:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe813fcc00/0xc1b37c4d47255f72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255f79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.546246:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789445729.546265:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe813fcc00/0xc1b37c4d47255f72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255f79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.546273:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe813fcc00/0xc1b37c4d47255f72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255f79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.546286:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789445729.546289:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe813fde00/0xc1b37c4d47255f48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255f4f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.546295:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fde00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1789445729.546298:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe813fde00/0xc1b37c4d47255f48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255f4f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.546305:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe813fde00/0xc1b37c4d47255f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255f4f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789445729.546311:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe813fde00/0xc1b37c4d47255f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255f4f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445729.546317:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789445729.546492:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe813fde00/0xc1b37c4d47255f48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255f4f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.546498:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789445729.546520:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe813fde00/0xc1b37c4d47255f48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255f4f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.546526:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe813fde00/0xc1b37c4d47255f48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255f4f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.546538:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445729.546540:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47255f2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255f33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.546546:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc200 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1789445729.546548:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47255f2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255f33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.546555:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47255f2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255f33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789445729.546561:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47255f2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255f33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445729.546566:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789445729.546582:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47255f2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255f33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.546587:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789445729.546592:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47255f2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255f33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.546608:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47255f2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255f33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.546617:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445729.546618:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445729.546620:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445729.546635:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369741985536:0@lo:103: 00000100:00100000:2.0:1789445729.546677:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445729.546726:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741985792:0@lo:103: 00000100:00100000:2.0:1789445729.546747:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445729.546763:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789445729.546767:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741985664:0@lo:103: 00000100:00100000:2.0:1789445729.546783:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445729.546806:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741985536 00000100:00100000:2.0:1789445729.546812:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741985536 00010000:00010000:2.0:1789445729.546835:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe813fce00/0xc1b37c4d47255f79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255f72 expref: 17 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445729.546852:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741985792 00000100:00100000:2.0:1789445729.546855:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741985792 00010000:00010000:2.0:1789445729.546864:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255f33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255f2c expref: 18 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445729.546874:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741985664 00000100:00100000:2.0:1789445729.546876:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741985664 00010000:00010000:2.0:1789445729.546884:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255f4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255f48 expref: 19 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445729.546895:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789445729.546909:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369741985536:12345-0@lo:103: 00010000:00010000:2.0:1789445729.547087:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445729.547094:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe813fce00/0xc1b37c4d47255f79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255f72 expref: 19 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.547105:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe813fce00/0xc1b37c4d47255f79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255f72 expref: 19 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.547129:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe813fce00/0xc1b37c4d47255f79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255f72 expref: 19 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.547143:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445729.547184:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:3313:x1876369741985536:12345-0@lo:103: Request processed in 276us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445729.547191:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789445729.547209:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789445729.547216:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:3311:x1876369741985792:12345-0@lo:103: 00010000:00010000:2.0:1789445729.547223:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445729.547228:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255f33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255f2c expref: 17 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.547235:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255f33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255f2c expref: 17 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.547245:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255f33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255f2c expref: 17 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.547255:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445729.547280:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:3311:x1876369741985792:12345-0@lo:103: Request processed in 65us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445729.547294:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789445729.547307:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789445729.547313:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:3311:x1876369741985664:12345-0@lo:103: 00010000:00010000:2.0:1789445729.547452:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445729.547458:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255f4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255f48 expref: 15 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.547467:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255f4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255f48 expref: 15 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.547477:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255f4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255f48 expref: 15 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.547487:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445729.547510:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:3311:x1876369741985664:12345-0@lo:103: Request processed in 198us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445729.547516:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789445729.547560:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741985664:0@lo:103: 00000100:00100000:2.0:1789445729.547568:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741985792:0@lo:103: 00000100:00100000:2.0:1789445729.547591:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369741985536:0@lo:103: 00010000:00010000:3.0:1789445729.547733:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789445729.547743:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+6:5835:x1876369741985024:12345-0@lo:104: Request processed in 2985us (3508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445729.547757:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789445729.547776:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789445729.547783:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:5835:x1876369741985280:12345-0@lo:104: 00010000:00010000:3.0:1789445729.547792:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d47255f02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255f09 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.547832:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789445729.547837:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:5835:x1876369741985280:12345-0@lo:104: Request processed in 56us (3470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445729.547842:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789445729.547856:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789445729.547861:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+4:5835:x1876369741985408:12345-0@lo:104: 00010000:00010000:3.0:1789445729.547869:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d47255ed8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255edf expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.547895:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789445729.547900:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+4:5835:x1876369741985408:12345-0@lo:104: Request processed in 39us (3014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445729.547905:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789445729.548032:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1876369741985280:0@lo:104: 00000100:00100000:1.0:1789445729.548041:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb99180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1876369741985408:0@lo:104: 00010000:00010000:1.0:1789445729.548098:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255f8e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.548281:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789445729.548288:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d47255f02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255f09 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.548295:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81679c00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1789445729.548300:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d47255f02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255f09 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.548314:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d47255f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255f09 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789445729.548321:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d47255f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255f09 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445729.548326:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789445729.548485:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d47255f02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255f09 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.548492:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789445729.548517:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d47255f02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255f09 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.548524:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d47255f02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255f09 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.548535:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445729.548539:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d47255ed8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255edf expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.548544:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81678e00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1789445729.548547:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d47255ed8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255edf expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.548554:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d47255ed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255edf expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789445729.548560:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d47255ed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255edf expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445729.548573:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789445729.548618:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369741985920:0@lo:103: 00000100:00100000:3.0:1789445729.548651:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789445729.548799:0:7626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1789445729.548807:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:5835:x1876369741985152:12345-0@lo:104: Request processed in 3247us (4506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445729.548835:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789445729.548944:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445729.549666:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d47255ed8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255edf expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.549675:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789445729.549728:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369741986048:0@lo:103: 00000100:00100000:3.0:1789445729.549766:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789445729.549865:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d47255ed8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255edf expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.549873:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d47255ed8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255edf expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.549891:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445729.549893:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445729.549894:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445729.549909:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741985920 00000100:00100000:2.0:1789445729.550029:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741985920 00010000:00010000:2.0:1789445729.550081:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe81679200/0xc1b37c4d47255f09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255f02 expref: 14 pid: 5834 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445729.550102:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741986048 00000100:00100000:2.0:1789445729.550106:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741986048 00010000:00010000:2.0:1789445729.550128:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255edf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255ed8 expref: 15 pid: 5836 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445729.550142:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789445729.550232:0:5827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789445729.550241:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789445729.550395:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789445729.550403:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:3313:x1876369741986048:12345-0@lo:103: 00010000:00010000:1.0:1789445729.550416:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445729.550421:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255edf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255ed8 expref: 15 pid: 5836 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.550432:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255edf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255ed8 expref: 15 pid: 5836 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.550445:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81505000/0xc1b37c4d47255edf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255ed8 expref: 15 pid: 5836 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.550458:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445729.550674:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:3312:x1876369741985920:12345-0@lo:103: 00010000:00010000:2.0:1789445729.550684:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445729.550689:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe81679200/0xc1b37c4d47255f09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255f02 expref: 14 pid: 5834 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.550710:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe81679200/0xc1b37c4d47255f09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255f02 expref: 14 pid: 5834 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.550721:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81679200/0xc1b37c4d47255f09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255f02 expref: 14 pid: 5834 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.550735:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255f8e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.550743:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255f8e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.550758:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255f8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.550766:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255f8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.550773:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255f8e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.550780:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255f8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.550787:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fda00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445729.550791:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255f8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.550800:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255f8e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.550826:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255f8e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.550836:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445729.550871:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:3312:x1876369741985920:12345-0@lo:103: Request processed in 722us (2219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445729.550878:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789445729.550932:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369741985920:0@lo:103: 00000100:00100000:1.0:1789445729.551577:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:3313:x1876369741986048:12345-0@lo:103: Request processed in 1173us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445729.551585:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789445729.551607:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255f8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.551615:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255f8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.551621:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255f8e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789445729.551638:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789445729.557913:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369741986048:0@lo:103: 00000100:00100000:3.0:1789445729.596400:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:7620:x1876369741984768:12345-0@lo:253: Request processed in 62435us (62782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445729.596427:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789445729.596589:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741984768:0@lo:253: 10000000:01000000:2.0:1789445729.596604:0:7620:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789445729.596607:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789445729.596609:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789445729.596611:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789445729.596612:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789445729.596613:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789445729.596615:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789445729.596616:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789445729.596617:0:7620:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789445729.596619:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789445729.596620:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789445729.596639:0:7620:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9afebb4dd000 from lustre-OST0001 10000000:01000000:2.0:1789445729.596661:0:7620:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789445729.596664:0:7620:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789445729.596671:0:7620:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9afea4f94d40 local copy 10000000:01000000:2.0:1789445729.596674:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789445729.596705:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47255f95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.596715:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47255f95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.596734:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47255f95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445729.596750:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741986176:0@lo:101: 00000100:00100000:2.0:1789445729.596781:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445729.596858:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b3180 going to sleep for 11 seconds 00000100:00100000:0.0:1789445729.596897:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741986176 00000100:00100000:0.0:1789445729.596904:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741986176 00000100:00100000:0.0:1789445729.597068:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789445729.597078:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+11:7620:x1876369741986176:12345-0@lo:101: 00010000:00010000:0.0:1789445729.597091:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445729.597103:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe8e988400/0xc1b37c4d47255f9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255f95 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445729.597137:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe8e988400/0xc1b37c4d47255f9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255f95 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445729.597146:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe8e988400/0xc1b37c4d47255f9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255f95 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445729.597154:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e988400, rc 0) 00000100:00100000:0.0:1789445729.597195:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:7620:x1876369741986176:12345-0@lo:101: Request processed in 119us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445729.597202:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789445729.597265:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741986176:0@lo:101: 00010000:00010000:3.0:1789445729.597278:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47255f95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc1b37c4d47255f9c expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.597297:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47255f95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc1b37c4d47255f9c expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445729.597396:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741986304:0@lo:501: 00000100:00100000:3.0:1789445729.597421:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445729.597707:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d2300 going to sleep for 11 seconds 00000100:00100000:2.0:1789445729.597751:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741986304 00000100:00100000:2.0:1789445729.597756:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741986304 00000100:00100000:1.0:1789445729.597794:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789445729.597804:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:7620:x1876369741986304:12345-0@lo:501: 00000100:00100000:1.0:1789445729.598014:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:7620:x1876369741986304:12345-0@lo:501: Request processed in 212us (591us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789445729.598022:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789445729.598195:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741986304:0@lo:501: 10000000:01000000:3.0:1789445729.598208:0:7620:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789445729.598235:0:7620:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789445729.598242:0:7620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47255f95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc1b37c4d47255f9c expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.598251:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47255f95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc1b37c4d47255f9c expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.598258:0:7620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47255f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc1b37c4d47255f9c expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.598289:0:7620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789445729.598308:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9afebb4dd000 10000000:01000000:3.0:1789445729.598313:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789445729.598317:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789445729.598328:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789445729.598332:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789445729.598334:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789445729.598354:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.598361:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.598369:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445729.598382:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741986432:0@lo:101: 00000100:00100000:3.0:1789445729.598409:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445729.598431:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789445729.598445:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741986432 00000100:00100000:3.0:1789445729.598449:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741986432 00000100:00100000:3.0:1789445729.598467:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789445729.598473:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:7620:x1876369741986432:12345-0@lo:101: 00010000:00010000:3.0:1789445729.598480:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445729.598489:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255faa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255fa3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.598506:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255fa3 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.598515:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255fa3 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.598522:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fda00, rc 0) 00000100:00100000:3.0:1789445729.598555:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741986432:12345-0@lo:101: Request processed in 83us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445729.598562:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789445729.598595:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741986432:0@lo:101: 00010000:00010000:3.0:1789445729.598605:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255faa expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.598613:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255faa expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445729.598666:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741986560:0@lo:501: 00000100:00100000:3.0:1789445729.598689:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445729.598700:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789445729.598713:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741986560 00000100:00100000:3.0:1789445729.598716:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741986560 00000100:00100000:3.0:1789445729.598732:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789445729.598738:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741986560:12345-0@lo:501: 00000100:00100000:3.0:1789445729.598912:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741986560:12345-0@lo:501: Request processed in 174us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445729.599075:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789445729.599120:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741986560:0@lo:501: 00000100:00100000:3.0:1789445729.599146:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741986688:0@lo:503: 00000100:00100000:3.0:1789445729.599186:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445729.599200:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789445729.599213:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741986688 00000100:00100000:3.0:1789445729.599216:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741986688 00000100:00100000:3.0:1789445729.599232:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789445729.599244:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741986688:12345-0@lo:503: 00000100:00100000:3.0:1789445729.599447:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741986688:12345-0@lo:503: Request processed in 203us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445729.599454:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789445729.599492:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741986688:0@lo:503: 00000040:00080000:3.0:1789445729.599736:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789445729.599792:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741986816:0@lo:502: 00000100:00100000:3.0:1789445729.599826:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445729.599840:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789445729.599854:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741986816 00000100:00100000:3.0:1789445729.599857:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741986816 00000100:00100000:3.0:1789445729.599875:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789445729.599881:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741986816:12345-0@lo:502: 00000100:00100000:3.0:1789445729.600206:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741986816:12345-0@lo:502: Request processed in 324us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445729.600213:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:1.0:1789445729.600311:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789445729.600319:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47255f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc1b37c4d47255f9c expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.600328:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81505400 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:1.0:1789445729.600332:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47255f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc1b37c4d47255f9c expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.600340:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47255f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc1b37c4d47255f9c expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789445729.600347:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47255f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc1b37c4d47255f9c expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445729.600352:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789445729.600373:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47255f95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc1b37c4d47255f9c expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.600379:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789445729.600405:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47255f95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc1b37c4d47255f9c expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.600412:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47255f95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc1b37c4d47255f9c expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.600435:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445729.600437:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445729.600438:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445729.600447:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789445729.600456:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741986944:0@lo:103: 00000100:00100000:1.0:1789445729.600487:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445729.600524:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741986944 00000100:00100000:1.0:1789445729.600529:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741986944 00000100:00100000:1.0:1789445729.600560:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789445729.600568:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:3311:x1876369741986944:12345-0@lo:103: 00010000:00010000:1.0:1789445729.600577:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445729.600589:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe8e988400/0xc1b37c4d47255f9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1b37c4d47255f95 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.600599:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445729.600627:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:3311:x1876369741986944:12345-0@lo:103: Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445729.600633:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789445729.600662:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741986944:0@lo:103: 00000100:00100000:0.0:1789445729.600793:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741986816:0@lo:502: 00000040:00080000:0.0:1789445729.601122:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789445729.601173:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789445729.601225:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789445729.601276:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789445729.601452:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789445729.601489:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789445729.601519:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741987072:0@lo:502: 00000100:00100000:0.0:1789445729.601585:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445729.601620:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb4bd8180 going to sleep for 11 seconds 00000100:00100000:0.0:1789445729.601703:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741987072 00000100:00100000:0.0:1789445729.601708:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741987072 00000100:00100000:0.0:1789445729.601736:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789445729.601743:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:7620:x1876369741987072:12345-0@lo:502: 00000100:00100000:0.0:1789445729.601897:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:7620:x1876369741987072:12345-0@lo:502: Request processed in 154us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445729.601904:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789445729.602145:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741987072:0@lo:502: 00000040:00080000:0.0:1789445729.602233:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789445729.602242:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1789445729.603378:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789445729.603389:0:7628:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789445729.603396:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445729.603398:0:7628:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789445729.603405:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789445729.603419:0:7628:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9afeba50cd40) 00000020:00000080:2.0:1789445729.603440:0:7628:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789445729.603446:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789445729.603499:0:7628:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afebb4dd000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789445729.603506:0:7628:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789445729.603511:0:7628:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc1b37c4d47255fb8 00010000:00010000:2.0:1789445729.612759:0:7628:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1789445729.613234:0:7628:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1789445729.617548:0:7628:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789445729.617851:0:7628:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789445729.625886:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1789445729.627707:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789445729.631235:0:7628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789445729.631248:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789445729.631256:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789445729.631259:0:7628:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789445729.631263:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789445729.631267:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789445729.631268:0:7628:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789445729.631271:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789445729.631273:0:7628:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789445729.631403:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789445729.631407:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789445729.631408:0:7628:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789445729.631412:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789445729.631605:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789445729.631631:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789445729.631655:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255faa expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.631668:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255faa expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445729.631677:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afebb4dd000 from 1 10000000:01000000:2.0:1789445729.631689:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789445729.631724:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255fbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.631732:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255fbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.631742:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255fbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445729.631763:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741987200:0@lo:101: 00000100:00100000:2.0:1789445729.631826:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445729.631881:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789445729.632636:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741987200 00000100:00100000:2.0:1789445729.632645:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741987200 00000100:00100000:2.0:1789445729.632693:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789445729.632701:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:7620:x1876369741987200:12345-0@lo:101: 00010000:00010000:2.0:1789445729.632715:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445729.632728:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81505c00/0xc1b37c4d47255fc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255fbf expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.632748:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81505c00/0xc1b37c4d47255fc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255fbf expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.633261:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81505c00/0xc1b37c4d47255fc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255fbf expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.633274:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81505c00, rc 0) 00000100:00100000:2.0:1789445729.634501:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741987200:12345-0@lo:101: Request processed in 1795us (2670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445729.634521:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789445729.639790:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741987200:0@lo:101: 00010000:00010000:0.0:1789445729.639820:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255fbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255fc6 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445729.639841:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255fbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255fc6 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445729.642331:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741987328:0@lo:501: 00000100:00100000:0.0:1789445729.642391:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445729.643127:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb4bd8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789445729.644505:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741987328 00000100:00100000:2.0:1789445729.644516:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741987328 00000100:00100000:2.0:1789445729.644567:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789445729.644576:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741987328:12345-0@lo:501: 00000100:00100000:2.0:1789445729.644890:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741987328:12345-0@lo:501: Request processed in 314us (2497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445729.644897:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789445729.645702:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741987328:0@lo:501: 00000100:00100000:1.0:1789445729.645753:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741987456:0@lo:503: 00000100:00100000:1.0:1789445729.645804:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445729.645933:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe85da7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445729.647849:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741987456 00000100:00100000:2.0:1789445729.647862:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741987456 00000100:00100000:0.0:1789445729.648087:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789445729.648100:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741987456:12345-0@lo:503: 00000100:00100000:0.0:1789445729.648493:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741987456:12345-0@lo:503: Request processed in 396us (2687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445729.648500:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789445729.648753:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741987456:0@lo:503: 00000040:00080000:1.0:1789445729.649030:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789445729.649165:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741987584:0@lo:502: 00000100:00100000:1.0:1789445729.649208:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445729.649238:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe85da7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445729.649310:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741987584 00000100:00100000:3.0:1789445729.649316:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741987584 00000100:00100000:3.0:1789445729.649345:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789445729.649353:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741987584:12345-0@lo:502: 00000100:00100000:3.0:1789445729.649503:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741987584:12345-0@lo:502: Request processed in 151us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445729.649510:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789445729.649976:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741987584:0@lo:502: 00000040:00080000:1.0:1789445729.650381:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789445729.650434:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789445729.650462:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741987712:0@lo:502: 00000100:00100000:1.0:1789445729.650508:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445729.650591:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe85da7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445729.650822:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741987712 00000100:00100000:2.0:1789445729.650829:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741987712 00000100:00100000:3.0:1789445729.650881:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789445729.650890:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741987712:12345-0@lo:502: 00000100:00100000:3.0:1789445729.651087:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741987712:12345-0@lo:502: Request processed in 197us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445729.651101:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789445729.651459:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741987712:0@lo:502: 00000040:00080000:1.0:1789445729.651572:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789445729.651597:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789445729.654748:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789445729.654760:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445729.654762:0:7632:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789445729.654770:0:7632:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afebb4dd000 00000020:00000080:3.0:1789445729.654772:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789445729.654790:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789445729.654793:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445729.654795:0:7632:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789445729.654798:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789445729.655193:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789445729.655225:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789445729.655260:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255fbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255fc6 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.655273:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255fbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255fc6 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445729.655314:0:7620:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789445729.655317:0:7620:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9afebb4dd000 10000000:01000000:1.0:1789445729.655320:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9afebb4dd000 10000000:01000000:1.0:1789445729.655324:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789445729.655330:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afebb4dd000 from 1 10000000:01000000:1.0:1789445729.655332:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789445729.655364:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678a00/0xc1b37c4d47255fcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.655387:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe81678a00/0xc1b37c4d47255fcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.655398:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe81678a00/0xc1b37c4d47255fcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445729.655420:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741987840:0@lo:101: 00000100:00100000:1.0:1789445729.655483:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445729.655520:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe85da7780 going to sleep for 11 seconds 00000100:00100000:3.0:1789445729.655582:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741987840 00000100:00100000:3.0:1789445729.655589:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741987840 00000100:00100000:3.0:1789445729.655624:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789445729.655634:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741987840:12345-0@lo:101: 00010000:00010000:3.0:1789445729.655648:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445729.655662:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255fd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255fcd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.655683:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255fcd expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.655695:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255fcd expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445729.655703:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fc000, rc 0) 00000100:00100000:3.0:1789445729.655745:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:7620:x1876369741987840:12345-0@lo:101: Request processed in 113us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445729.655751:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789445729.656278:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741987840:0@lo:101: 00010000:00010000:1.0:1789445729.656293:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe81678a00/0xc1b37c4d47255fcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255fd4 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.656302:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe81678a00/0xc1b37c4d47255fcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255fd4 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445729.656388:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741987968:0@lo:501: 00000100:00100000:1.0:1789445729.656418:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445729.656498:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe85da7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789445729.656615:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741987968 00000100:00100000:0.0:1789445729.656620:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741987968 00000100:00100000:0.0:1789445729.656645:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789445729.656653:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:7620:x1876369741987968:12345-0@lo:501: 00000100:00100000:0.0:1789445729.656878:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:7620:x1876369741987968:12345-0@lo:501: Request processed in 225us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445729.656885:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789445729.656945:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741987968:0@lo:501: 00000100:00100000:0.0:1789445729.656973:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741988096:0@lo:503: 00000100:00100000:0.0:1789445729.657012:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445729.657034:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb4bd8540 going to sleep for 11 seconds 00000100:00100000:0.0:1789445729.657068:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741988096 00000100:00100000:0.0:1789445729.657072:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741988096 00000100:00100000:0.0:1789445729.657089:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789445729.657101:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:7620:x1876369741988096:12345-0@lo:503: 00000100:00100000:0.0:1789445729.657246:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:7620:x1876369741988096:12345-0@lo:503: Request processed in 144us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445729.657252:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789445729.657288:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741988096:0@lo:503: 00000040:00080000:0.0:1789445729.657542:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789445729.657609:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741988224:0@lo:502: 00000100:00100000:0.0:1789445729.657643:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445729.657667:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb4bd8540 going to sleep for 11 seconds 00000100:00100000:0.0:1789445729.657681:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741988224 00000100:00100000:0.0:1789445729.657684:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741988224 00000100:00100000:0.0:1789445729.657704:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789445729.657711:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:7620:x1876369741988224:12345-0@lo:502: 00000100:00100000:0.0:1789445729.657876:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:7620:x1876369741988224:12345-0@lo:502: Request processed in 157us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445729.657883:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789445729.657922:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741988224:0@lo:502: 00000040:00080000:0.0:1789445729.658219:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789445729.658271:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789445729.658309:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789445729.658357:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789445729.658395:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789445729.658455:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789445729.658493:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789445729.658529:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789445729.658595:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789445729.658634:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789445729.658679:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789445729.658725:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789445729.658759:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789445729.658794:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789445729.658836:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789445729.658870:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789445729.658902:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789445729.658945:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789445729.658976:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789445729.659006:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789445729.659078:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789445729.659141:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789445729.659177:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789445729.659225:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789445729.659268:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789445729.659328:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789445729.659393:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789445729.669900:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1789445729.670178:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789445729.670428:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1789445729.670457:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1789445729.670483:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1789445729.670508:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1789445729.670544:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1789445729.670570:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1789445729.670625:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1789445729.670653:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1789445729.670695:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741988352:0@lo:502: 00000100:00100000:0.0:1789445729.670772:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445729.670817:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb4bd8540 going to sleep for 11 seconds 00000100:00100000:1.0:1789445729.670878:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741988352 00000100:00100000:1.0:1789445729.670885:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741988352 00000100:00100000:1.0:1789445729.670939:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789445729.670947:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:7620:x1876369741988352:12345-0@lo:502: 00000100:00100000:1.0:1789445729.671177:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:7620:x1876369741988352:12345-0@lo:502: Request processed in 230us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445729.671193:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789445729.674125:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741988352:0@lo:502: 00000040:00080000:0.0:1789445729.674307:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1789445729.674322:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789445729.677756:0:7633:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789445729.677772:0:7633:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9afe9f924d40) 00000020:00000080:0.0:1789445729.677792:0:7633:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1789445729.677883:0:7633:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afebb4dd000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789445729.677887:0:7633:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afebb4dd000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789445729.677889:0:7633:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afebb4dd000 3 00010000:00080000:0.0:1789445729.678316:0:7633:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afeba784000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.159@tcp at head 00010000:00010000:1.0:1789445729.681345:0:7633:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1789445729.681547:0:7633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789445729.681587:0:7633:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789445729.681600:0:7633:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc1b37c4d47255fe2 00000100:00080000:1.0:1789445729.681611:0:7633:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789445729.681622:0:7633:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9afeba784000 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:1.0:1789445729.681655:0:7633:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afeb5c79880 x1876369741988480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789445729.681676:0:7633:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789445729.683352:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876369741988480:0@lo:38: 00000100:00100000:2.0:1789445729.683422:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445729.684298:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741988480 00000100:00100000:1.0:1789445729.684308:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741988480 00000100:00100000:1.0:1789445729.684353:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789445729.684360:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876369741988480:12345-0@lo:38: 00010000:00080000:1.0:1789445729.684387:0:5840:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:1.0:1789445729.684435:0:5840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc1b37c4d47255fe9 00000004:00100000:1.0:1789445729.684451:0:5840:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789445729.684485:0:5840:0:(import.c:65:import_set_state_nolock()) ffff9afeba7a4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789445729.684546:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876369741988480:12345-0@lo:38: Request processed in 185us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445729.684553:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789445729.684598:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afeb5c79880 x1876369741988480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789445739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445729.684609:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789445729.684616:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789445729.684624:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789445729.684629:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789445729.684631:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afeba784000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789445729.684645:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876369741988480:0@lo:38: 00000100:00100000:3.0:1789445729.687257:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789445729.687281:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369741988608:0@lo:400: 00000100:00100000:3.0:1789445729.687525:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445729.687725:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369741988864:0@lo:400: 00000100:00100000:3.0:1789445729.687791:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445729.687815:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789445729.687822:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369741988736:0@lo:400: 00000100:00100000:3.0:1789445729.687843:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445729.687873:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741988608 00000100:00100000:3.0:1789445729.687880:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741988608 00000100:00100000:3.0:1789445729.687921:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741988736 00000100:00100000:3.0:1789445729.687924:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741988736 00000100:00100000:3.0:1789445729.687941:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789445729.687949:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369741988608:12345-0@lo:400: 00000100:00100000:3.0:1789445729.687998:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369741988608:12345-0@lo:400: Request processed in 49us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445729.688005:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789445729.688023:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789445729.688031:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369741988736:12345-0@lo:400: 00000100:00100000:2.0:1789445729.689159:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741988864 00000100:00100000:2.0:1789445729.689168:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741988864 00000100:00100000:2.0:1789445729.689218:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789445729.689227:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369741988864:12345-0@lo:400: 00000100:00100000:2.0:1789445729.689287:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369741988864:12345-0@lo:400: Request processed in 62us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445729.689293:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1789445729.689666:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1789445729.689765:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1789445729.689786:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789445729.689800:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678a00/0xc1b37c4d47255fcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255fd4 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.689811:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe81678a00/0xc1b37c4d47255fcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255fd4 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445729.689842:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369741988736:12345-0@lo:400: Request processed in 1810us (1996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445729.689853:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:01000004:1.0:1789445729.689855:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789445729.689858:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789445729.689860:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789445729.689862:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789445729.689864:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789445729.689865:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789445729.689867:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789445729.689869:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789445729.689870:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789445729.689872:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789445729.689874:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789445729.689878:0:7620:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789445729.689881:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789445729.689882:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789445729.689884:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789445729.689885:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789445729.689886:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789445729.689888:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789445729.689889:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789445729.689891:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789445729.689892:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789445729.689893:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789445729.689894:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00080000:3.0:1789445729.689905:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afeadb99f80 x1876369741988608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445729.689920:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369741988608:0@lo:400: 00010000:00080000:3.0:1789445729.690034:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afeadb98380 x1876369741988736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445729.690060:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369741988736:0@lo:400: 00010000:00080000:3.0:1789445729.690081:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afeadb9b800 x1876369741988864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445729.690090:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369741988864:0@lo:400: 10000000:01000000:1.0:1789445729.690160:0:7620:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789445729.690176:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741988992:0@lo:253: 00000100:00100000:2.0:1789445729.690401:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42d80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7634:1876369741989120:0@lo:901: 00000100:00100000:2.0:1789445729.690442:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445729.690469:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b3240 going to sleep for 11 seconds 00000100:00100000:1.0:1789445729.690549:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445729.690586:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe85da7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445729.690720:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741988992 00000100:00100000:2.0:1789445729.690726:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741988992 00000100:00100000:2.0:1789445729.690762:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789445729.690777:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:7620:x1876369741988992:12345-0@lo:253: 20000000:01000000:2.0:1789445729.690802:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789445729.690815:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789445729.692746:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741989120 00000100:00100000:2.0:1789445729.692760:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741989120 00000100:00100000:2.0:1789445729.692827:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789445729.692835:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7634:x1876369741989120:12345-0@lo:901: 00000100:00080000:1.0:1789445729.693293:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445729.693684:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7634:x1876369741989120:12345-0@lo:901: Request processed in 848us (3239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445729.693692:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789445729.700987:0:7634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afea4d42d80 x1876369741989120/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789445745 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445729.701007:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42d80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7634:1876369741989120:0@lo:901: 20000000:01000000:3.0:1789445729.733604:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789445729.733621:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789445729.734138:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789445729.734143:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789445729.734166:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255ff0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.734197:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe81505e00/0xc1b37c4d47255f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255f3a expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.734206:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255ff0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.734247:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe81505e00/0xc1b37c4d47255f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255f3a expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445729.734273:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe81505e00/0xc1b37c4d47255f41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255f3a expref: 14 pid: 5836 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445729.734287:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876369741989248:0@lo:104: 00000100:00100000:2.0:1789445729.734346:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445729.734383:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b3180 going to sleep for 11 seconds 00000100:00100000:1.0:1789445729.735202:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741989248 00000100:00100000:1.0:1789445729.735211:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741989248 00000100:00100000:1.0:1789445729.735270:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789445729.735279:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:5856:x1876369741989248:12345-0@lo:104: 00010000:00010000:1.0:1789445729.735294:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe813fc600/0xc1b37c4d47255f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255f41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735357:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789445729.735364:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:5856:x1876369741989248:12345-0@lo:104: Request processed in 86us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445729.735370:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789445729.735391:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789445729.735396:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe813fc600/0xc1b37c4d47255f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255f41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735404:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc600 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:1.0:1789445729.735408:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe813fc600/0xc1b37c4d47255f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255f41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735417:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe813fc600/0xc1b37c4d47255f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255f41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789445729.735436:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe813fc600/0xc1b37c4d47255f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255f41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445729.735442:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789445729.735469:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe813fc600/0xc1b37c4d47255f3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255f41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735475:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789445729.735491:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe813fc600/0xc1b37c4d47255f3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255f41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735498:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe813fc600/0xc1b37c4d47255f3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255f41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735514:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445729.735516:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445729.735518:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445729.735525:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789445729.735536:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741989376:0@lo:103: 00000100:00100000:1.0:1789445729.735568:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445729.735601:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741989376 00000100:00100000:1.0:1789445729.735605:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741989376 00010000:00010000:1.0:1789445729.735622:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe81505e00/0xc1b37c4d47255f41 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255f3a expref: 15 pid: 5836 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445729.735643:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789445729.735649:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe919b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:3311:x1876369741989376:12345-0@lo:103: 00010000:00010000:1.0:1789445729.735659:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445729.735663:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe81505e00/0xc1b37c4d47255f41 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255f3a expref: 15 pid: 5836 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735678:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe81505e00/0xc1b37c4d47255f41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255f3a expref: 15 pid: 5836 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735693:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255ff0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735701:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255ff0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789445729.735714:0:7627:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001571254s 00010000:00010000:1.0:1789445729.735718:0:7627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255ff0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735725:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255ff0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735732:0:7627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255ff0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735738:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255ff0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735743:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81505400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445729.735747:0:7627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255ff0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735754:0:7627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255ff0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735760:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255ff0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735779:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445729.735810:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe919b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:3311:x1876369741989376:12345-0@lo:103: Request processed in 160us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445729.735817:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789445729.735883:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741989376:0@lo:103: 00010000:00010000:1.0:1789445729.735908:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81505e00/0xc1b37c4d47255f41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255f3a expref: 14 pid: 5836 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445729.735932:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876369741989248:0@lo:104: 00010000:00010000:1.0:1789445729.735945:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255ff0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735953:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255ff0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735959:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255ff0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445729.735964:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81505400/0xc1b37c4d47255ff0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445729.746848:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:7620:x1876369741988992:12345-0@lo:253: Request processed in 56065us (56291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445729.746861:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789445729.746958:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7620:1876369741988992:0@lo:253: 10000000:01000000:2.0:1789445729.746972:0:7620:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789445729.746976:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789445729.746978:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789445729.746979:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789445729.746981:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789445729.746982:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789445729.746983:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789445729.746984:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789445729.746986:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789445729.746987:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789445729.746989:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789445729.746990:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789445729.747005:0:7620:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789445729.752807:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789445729.753102:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789445729.753406:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789445729.753599:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789445729.753814:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789445729.754651:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789445729.755872:0:7620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789445729.971252:0:7620:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789445729.971259:0:7620:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789445729.971292:0:7620:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789445729.971345:0:7620:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.159@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789445729.971357:0:7620:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789445729.971381:0:7620:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789445730.010257:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445731.047149:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445732.064620:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445733.083016:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445733.471517:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789445733.471538:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369741989504:0@lo:13: 00000100:00100000:3.0:1789445733.471600:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445733.471663:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741989504 00000100:00100000:3.0:1789445733.471670:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741989504 00000100:00100000:3.0:1789445733.471721:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789445733.471730:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369741989504:12345-0@lo:13: 00002000:00000024:3.0:1789445733.471760:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789445733.471801:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369741989504:12345-0@lo:13: Request processed in 72us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445733.471808:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789445733.471829:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789445733.471857:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4d41c00 x1876369741989504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445733.471875:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369741989504:0@lo:13: 00010000:00010000:1.0:1789445734.113159:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445735.012114:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369741989888:0@lo:400: 00000100:00100000:0.0:1789445735.012181:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445735.012236:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789445735.012242:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369741990016:0@lo:400: 00000100:00100000:0.0:1789445735.012267:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445735.012308:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741989888 00000100:00100000:0.0:1789445735.012314:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741989888 00000100:00100000:0.0:1789445735.012366:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789445735.012378:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369741989888:12345-0@lo:400: 00000100:00100000:0.0:1789445735.012427:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369741989888:12345-0@lo:400: Request processed in 54us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445735.012448:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789445735.012473:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741990016 00000100:00100000:0.0:1789445735.012477:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741990016 00000100:00100000:0.0:1789445735.012505:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789445735.012511:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369741990016:12345-0@lo:400: 00000100:00100000:0.0:1789445735.012544:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369741990016:12345-0@lo:400: Request processed in 33us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445735.012550:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789445735.012585:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afe9ee7ca80 x1876369741990016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445735.012599:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369741990016:0@lo:400: 00010000:00080000:0.0:1789445735.012610:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afe9ee7c700 x1876369741989888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445735.012618:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369741989888:0@lo:400: 00000100:00100000:3.0:1789445735.013274:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369741989632:0@lo:400: 00000100:00100000:3.0:1789445735.013322:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445735.013350:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369741990144:0@lo:400: 00000100:00100000:3.0:1789445735.013380:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445735.013401:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789445735.013407:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369741989760:0@lo:400: 00000100:00100000:3.0:1789445735.013426:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789445735.013452:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789445735.013457:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445735.013467:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741990144 00000100:00100000:3.0:1789445735.013471:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741990144 00000100:00100000:3.0:1789445735.013499:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741989760 00000100:00100000:3.0:1789445735.013502:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741989760 00000100:00100000:3.0:1789445735.013516:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789445735.013522:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369741990144:12345-0@lo:400: 00000100:00100000:3.0:1789445735.013558:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369741990144:12345-0@lo:400: Request processed in 36us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445735.013564:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789445735.013580:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789445735.013586:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369741989760:12345-0@lo:400: 00000100:00100000:3.0:1789445735.013610:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369741989760:12345-0@lo:400: Request processed in 25us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445735.013615:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789445735.013630:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789445735.013645:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afe9ee7c380 x1876369741989760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445735.013656:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369741989760:0@lo:400: 00010000:00080000:3.0:1789445735.013666:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afe9ee7e680 x1876369741990144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445735.013681:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369741990144:0@lo:400: 00000100:00100000:0.0:1789445735.013881:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741989632 00000100:00100000:0.0:1789445735.013886:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741989632 00000100:00100000:0.0:1789445735.013929:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789445735.013936:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:3312:x1876369741989632:12345-0@lo:400: 00000100:00100000:0.0:1789445735.013973:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:3312:x1876369741989632:12345-0@lo:400: Request processed in 38us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445735.013980:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789445735.014370:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369741989632:0@lo:400: 00010000:00010000:1.0:1789445735.130254:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789445735.514151:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789445735.514160:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afe8533d800 from 30 10000000:01000000:3.0:1789445735.514167:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789445735.514216:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe813fce00/0xc1b37c4d47255ff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445735.514228:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe813fce00/0xc1b37c4d47255ff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445735.514324:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe813fce00/0xc1b37c4d47255ff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445735.514347:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741990272:0@lo:101: 00000100:00100000:3.0:1789445735.514415:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445735.514584:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf5e6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789445735.517025:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741990272 00000100:00100000:1.0:1789445735.517054:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741990272 00000100:00100000:1.0:1789445735.517117:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789445735.517128:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:5838:x1876369741990272:12345-0@lo:101: 00010000:00010000:1.0:1789445735.517144:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445735.517161:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81678e00/0xc1b37c4d47255ffe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47255ff7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.517188:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81678e00/0xc1b37c4d47255ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47255ff7 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.517198:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81678e00/0xc1b37c4d47255ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255ff7 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.517206:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81678e00, rc 0) 00000100:00100000:0.0:1789445735.519165:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:5838:x1876369741990272:12345-0@lo:101: Request processed in 2031us (4740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445735.519176:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789445735.520935:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741990272:0@lo:101: 00010000:00010000:1.0:1789445735.520966:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe813fce00/0xc1b37c4d47255ff7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255ffe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.520978:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe813fce00/0xc1b37c4d47255ff7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255ffe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445735.521101:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741990400:0@lo:501: 00000100:00100000:1.0:1789445735.521155:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445735.521193:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4e1f300 going to sleep for 11 seconds 00000100:00100000:0.0:1789445735.521385:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741990400 00000100:00100000:0.0:1789445735.521405:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741990400 00000100:00100000:0.0:1789445735.521455:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789445735.521464:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:5838:x1876369741990400:12345-0@lo:501: 00000100:00100000:0.0:1789445735.521792:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:5838:x1876369741990400:12345-0@lo:501: Request processed in 328us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445735.521800:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789445735.521906:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741990400:0@lo:501: 00000100:00100000:1.0:1789445735.521938:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741990528:0@lo:503: 00000100:00100000:1.0:1789445735.521977:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445735.522064:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4e1f300 going to sleep for 11 seconds 00000100:00100000:0.0:1789445735.527422:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741990528 00000100:00100000:0.0:1789445735.527436:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741990528 00000100:00100000:0.0:1789445735.527493:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789445735.527503:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:5838:x1876369741990528:12345-0@lo:503: 00000100:00100000:0.0:1789445735.527864:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:5838:x1876369741990528:12345-0@lo:503: Request processed in 362us (5886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445735.527872:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789445735.529823:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741990528:0@lo:503: 00000100:00100000:0.0:1789445735.530318:0:7978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7978:1876369741990656:0@lo:502: 00000100:00100000:0.0:1789445735.530390:0:7978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445735.530434:0:7978:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afead97e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789445735.530478:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741990656 00000100:00100000:2.0:1789445735.530486:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741990656 00000100:00100000:2.0:1789445735.530529:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789445735.530540:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:7978:x1876369741990656:12345-0@lo:502: 00000100:00100000:2.0:1789445735.530831:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:7978:x1876369741990656:12345-0@lo:502: Request processed in 293us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445735.530839:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789445735.530988:0:7978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7978:1876369741990656:0@lo:502: 00000100:00100000:0.0:1789445735.531030:0:7978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7978:1876369741990784:0@lo:502: 00000100:00100000:0.0:1789445735.531101:0:7978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445735.531119:0:7978:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afead97e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789445735.531174:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741990784 00000100:00100000:2.0:1789445735.531179:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741990784 00000100:00100000:2.0:1789445735.531214:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789445735.531221:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:7978:x1876369741990784:12345-0@lo:502: 00000100:00100000:2.0:1789445735.531361:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:7978:x1876369741990784:12345-0@lo:502: Request processed in 140us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445735.531368:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789445735.531994:0:7978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7978:1876369741990784:0@lo:502: 00000040:00080000:0.0:1789445735.532021:0:7978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789445735.533003:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789445735.533029:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789445735.533070:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe813fce00/0xc1b37c4d47255ff7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255ffe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445735.533091:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe813fce00/0xc1b37c4d47255ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255ffe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445735.533101:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789445735.533104:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789445735.533107:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789445735.533139:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47256005 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445735.533147:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47256005 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445735.533156:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47256005 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445735.533175:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741990912:0@lo:101: 00000100:00100000:2.0:1789445735.533230:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445735.533266:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b3180 going to sleep for 11 seconds 00000100:00100000:0.0:1789445735.533526:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741990912 00000100:00100000:0.0:1789445735.533533:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741990912 00000100:00100000:0.0:1789445735.533668:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789445735.533685:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:5838:x1876369741990912:12345-0@lo:101: 00010000:00010000:0.0:1789445735.533699:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445735.533711:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe8e989400/0xc1b37c4d4725600c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47256005 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445735.533733:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe8e989400/0xc1b37c4d4725600c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47256005 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445735.533743:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe8e989400/0xc1b37c4d4725600c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47256005 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445735.533750:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989400, rc 0) 00000100:00100000:0.0:1789445735.535649:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369741990912:12345-0@lo:101: Request processed in 1959us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445735.535660:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000001:02000400:3.0:1789445735.537654:0:7977:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg659-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789445735.542235:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741990912:0@lo:101: 00010000:00010000:1.0:1789445735.542269:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47256005 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725600c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.542284:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47256005 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d4725600c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445735.544984:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741991040:0@lo:501: 00000100:00100000:0.0:1789445735.545076:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445735.545130:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afead97e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445735.545249:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741991040 00000100:00100000:2.0:1789445735.545256:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741991040 00000100:00100000:2.0:1789445735.545343:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789445735.545353:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369741991040:12345-0@lo:501: 00000100:00100000:2.0:1789445735.545616:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369741991040:12345-0@lo:501: Request processed in 263us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445735.545624:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789445735.545932:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741991040:0@lo:501: 00000100:00100000:1.0:1789445735.545970:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741991168:0@lo:503: 00000100:00100000:1.0:1789445735.546011:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445735.546041:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4e1f180 going to sleep for 11 seconds 00000100:00100000:2.0:1789445735.546178:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741991168 00000100:00100000:2.0:1789445735.546183:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741991168 00000100:00100000:2.0:1789445735.546215:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789445735.546221:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369741991168:12345-0@lo:503: 00000100:00100000:2.0:1789445735.546522:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369741991168:12345-0@lo:503: Request processed in 300us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445735.546529:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789445735.546979:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741991168:0@lo:503: 00000100:00100000:1.0:1789445735.547399:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7979:1876369741991296:0@lo:502: 00000100:00100000:1.0:1789445735.547444:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445735.547478:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4e1f300 going to sleep for 11 seconds 00000100:00100000:0.0:1789445735.548342:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741991296 00000100:00100000:0.0:1789445735.548350:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741991296 00000100:00100000:0.0:1789445735.548400:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789445735.548409:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:7979:x1876369741991296:12345-0@lo:502: 00000100:00100000:0.0:1789445735.548709:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:7979:x1876369741991296:12345-0@lo:502: Request processed in 301us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445735.548717:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789445735.553379:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7979:1876369741991296:0@lo:502: 00000020:01000000:0.0:1789445735.559468:0:7979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789445735.559483:0:7979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789445735.559486:0:7979:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789445735.559504:0:7979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789445735.559506:0:7979:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789445735.559551:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7979:1876369741991424:0@lo:502: 00000100:00100000:0.0:1789445735.559703:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445735.559792:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afead97ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789445735.562657:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741991424 00000100:00100000:1.0:1789445735.562675:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741991424 00000100:00100000:0.0:1789445735.562802:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789445735.562813:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:7979:x1876369741991424:12345-0@lo:502: 00000100:00100000:0.0:1789445735.563116:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:7979:x1876369741991424:12345-0@lo:502: Request processed in 305us (3412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445735.563123:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789445735.563200:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7979:1876369741991424:0@lo:502: 00000020:01000000:0.0:1789445735.563433:0:7979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789445735.563441:0:7979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789445735.563443:0:7979:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789445735.563449:0:7979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1789445735.563602:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789445735.563621:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789445735.563631:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47256005 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725600c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445735.563641:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47256005 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725600c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789445735.563651:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789445735.563660:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afe9d560800 from 30 10000000:01000000:3.0:1789445735.563663:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789445735.563690:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47256013 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445735.563698:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47256013 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445735.563707:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47256013 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445735.563725:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741991552:0@lo:101: 00000100:00100000:3.0:1789445735.563761:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445735.563799:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf5e6480 going to sleep for 11 seconds 00000100:00100000:1.0:1789445735.563930:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741991552 00000100:00100000:1.0:1789445735.563935:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741991552 00000100:00100000:1.0:1789445735.563973:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789445735.563981:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369741991552:12345-0@lo:101: 00010000:00010000:1.0:1789445735.563990:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445735.564002:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81679c00/0xc1b37c4d4725601a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47256013 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.564037:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81679c00/0xc1b37c4d4725601a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47256013 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.564070:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81679c00/0xc1b37c4d4725601a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47256013 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.564087:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81679c00, rc 0) 00000100:00100000:1.0:1789445735.564124:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369741991552:12345-0@lo:101: Request processed in 144us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445735.564129:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789445735.564160:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741991552:0@lo:101: 00010000:00010000:1.0:1789445735.564172:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47256013 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725601a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.564181:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47256013 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d4725601a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445735.564227:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741991680:0@lo:501: 00000100:00100000:1.0:1789445735.564267:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445735.564281:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4e1f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445735.564292:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741991680 00000100:00100000:1.0:1789445735.564295:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741991680 00000100:00100000:1.0:1789445735.564317:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789445735.564322:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369741991680:12345-0@lo:501: 00000100:00100000:1.0:1789445735.564537:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369741991680:12345-0@lo:501: Request processed in 213us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445735.564544:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789445735.564580:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741991680:0@lo:501: 00000100:00100000:1.0:1789445735.564818:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741991808:0@lo:503: 00000100:00100000:1.0:1789445735.564853:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445735.564883:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4e1f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445735.564935:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741991808 00000100:00100000:3.0:1789445735.564939:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741991808 00000100:00100000:3.0:1789445735.564970:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789445735.564976:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369741991808:12345-0@lo:503: 00000100:00100000:3.0:1789445735.565144:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369741991808:12345-0@lo:503: Request processed in 167us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445735.565150:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789445735.565357:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741991808:0@lo:503: 00000100:00100000:2.0:1789445735.568723:0:7980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7980:1876369741991936:0@lo:502: 00000100:00100000:2.0:1789445735.568804:0:7980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445735.568879:0:7980:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445735.571870:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741991936 00000100:00100000:3.0:1789445735.571884:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741991936 00000100:00100000:3.0:1789445735.571953:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789445735.571963:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:7980:x1876369741991936:12345-0@lo:502: 00000100:00100000:3.0:1789445735.572287:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:7980:x1876369741991936:12345-0@lo:502: Request processed in 325us (3482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445735.572294:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789445735.572571:0:7980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7980:1876369741991936:0@lo:502: 00000100:00100000:2.0:1789445735.572649:0:7980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7980:1876369741992064:0@lo:502: 00000100:00100000:2.0:1789445735.572689:0:7980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445735.572724:0:7980:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445735.572769:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741992064 00000100:00100000:1.0:1789445735.572774:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741992064 00000100:00100000:1.0:1789445735.572809:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789445735.572816:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:7980:x1876369741992064:12345-0@lo:502: 00000100:00100000:1.0:1789445735.572981:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:7980:x1876369741992064:12345-0@lo:502: Request processed in 164us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445735.572988:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789445735.573219:0:7980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7980:1876369741992064:0@lo:502: 00000040:00080000:2.0:1789445735.573249:0:7980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789445735.573456:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789445735.573475:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789445735.573483:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47256013 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725601a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.573493:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47256013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725601a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445735.573503:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789445735.573505:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afe9d560800 from 5 10000000:01000000:1.0:1789445735.573508:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789445735.573534:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.573542:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.573564:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445735.573578:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741992192:0@lo:101: 00000100:00100000:1.0:1789445735.573618:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445735.573644:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4e1fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789445735.573734:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741992192 00000100:00100000:2.0:1789445735.573739:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741992192 00000100:00100000:2.0:1789445735.573771:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789445735.573778:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369741992192:12345-0@lo:101: 00010000:00010000:2.0:1789445735.573787:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445735.573801:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81505e00/0xc1b37c4d47256028 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47256021 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445735.573821:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81505e00/0xc1b37c4d47256028 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47256021 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445735.573832:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81505e00/0xc1b37c4d47256028 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47256021 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445735.573853:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81505e00, rc 0) 00000100:00100000:2.0:1789445735.573882:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369741992192:12345-0@lo:101: Request processed in 104us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445735.573900:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789445735.574025:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741992192:0@lo:101: 00010000:00010000:1.0:1789445735.574037:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256028 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.574075:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47256028 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445735.574140:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741992320:0@lo:256: 00000100:00100000:1.0:1789445735.574170:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445735.574186:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4e1fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789445735.574277:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741992320 00000100:00100000:3.0:1789445735.574288:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741992320 00000100:00100000:3.0:1789445735.574312:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789445735.574319:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369741992320:12345-0@lo:256: 20000000:01000000:3.0:1789445735.574332:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789445735.574348:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789445735.574351:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789445735.574423:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369741992320:12345-0@lo:256: Request processed in 105us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445735.574429:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789445735.574553:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741992320:0@lo:256: 10000000:01000000:1.0:1789445735.574630:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789445735.574639:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256028 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.574647:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256028 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445735.574654:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789445735.574656:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789445735.574665:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789445735.574684:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678800/0xc1b37c4d4725602f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.574690:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe81678800/0xc1b37c4d4725602f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.574697:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe81678800/0xc1b37c4d4725602f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445735.574709:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741992448:0@lo:101: 00000100:00100000:1.0:1789445735.574735:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445735.574765:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4e1fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789445735.575202:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741992448 00000100:00100000:3.0:1789445735.575208:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741992448 00000100:00100000:3.0:1789445735.575249:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789445735.575256:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369741992448:12345-0@lo:101: 00010000:00010000:3.0:1789445735.575265:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445735.575276:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256036 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d4725602f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445735.575294:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d4725602f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445735.575304:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d4725602f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445735.575311:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fde00, rc 0) 00000100:00100000:3.0:1789445735.575345:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369741992448:12345-0@lo:101: Request processed in 90us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445735.575350:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789445735.575728:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741992448:0@lo:101: 00010000:00010000:1.0:1789445735.575740:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe81678800/0xc1b37c4d4725602f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256036 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.575748:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe81678800/0xc1b37c4d4725602f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47256036 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445735.575804:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741992576:0@lo:501: 00000100:00100000:1.0:1789445735.575831:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445735.575863:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4e1fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789445735.576087:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741992576 00000100:00100000:3.0:1789445735.576092:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741992576 00000100:00100000:3.0:1789445735.576128:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789445735.576134:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369741992576:12345-0@lo:501: 00000100:00100000:3.0:1789445735.576526:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369741992576:12345-0@lo:501: Request processed in 392us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445735.576533:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789445735.576612:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741992576:0@lo:501: 00000100:00100000:1.0:1789445735.576643:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741992704:0@lo:503: 00000100:00100000:1.0:1789445735.576684:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445735.576716:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4e1fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789445735.576818:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741992704 00000100:00100000:2.0:1789445735.576823:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741992704 00000100:00100000:2.0:1789445735.576856:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789445735.576864:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369741992704:12345-0@lo:503: 00000100:00100000:2.0:1789445735.577197:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369741992704:12345-0@lo:503: Request processed in 334us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445735.577205:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789445735.577432:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741992704:0@lo:503: 00000100:00100000:3.0:1789445735.578014:0:7982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb99500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7982:1876369741992832:0@lo:502: 00000100:00100000:3.0:1789445735.578100:0:7982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445735.578124:0:7982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf5e6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789445735.578215:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741992832 00000100:00100000:1.0:1789445735.578226:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741992832 00000100:00100000:1.0:1789445735.578275:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789445735.578282:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:7982:x1876369741992832:12345-0@lo:502: 00000100:00100000:1.0:1789445735.578524:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:7982:x1876369741992832:12345-0@lo:502: Request processed in 243us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445735.578531:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789445735.581907:0:7982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb99500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7982:1876369741992832:0@lo:502: 00000020:01000000:3.0:1789445735.581955:0:7982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789445735.581963:0:7982:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789445735.581970:0:7982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445735.581972:0:7982:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789445735.581979:0:7982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789445735.581983:0:7982:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.159@tcp to nid 0x20000c0a8ce9f (192.168.206.159@tcp) 00000020:01000000:3.0:1789445735.582015:0:7982:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789445735.582020:0:7982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789445735.582095:0:7982:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9afeb9e54d40) 00000020:00000080:3.0:1789445735.582119:0:7982:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1789445735.582128:0:7982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789445735.582220:0:7982:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789445735.582226:0:7982:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789445735.582243:0:7982:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1b37c4d47256044 00010000:00080000:3.0:1789445735.582273:0:7982:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afebf739800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.159@tcp at head 00010000:00010000:3.0:1789445735.582502:0:7982:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1789445735.582856:0:7982:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789445735.582869:0:7982:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789445735.583426:0:7982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789445735.583636:0:7982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789445735.583685:0:7982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789445735.583743:0:7982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789445735.589809:0:7983:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789445735.589817:0:7983:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789445735.594640:0:7982:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789445735.594656:0:7982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789445735.594693:0:7982:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789445735.594716:0:7982:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1b37c4d4725604b 00000100:00080000:1.0:1789445735.594727:0:7982:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789445735.594739:0:7982:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9afebf739800 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:1.0:1789445735.594775:0:7982:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afeb5c78380 x1876369741992960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789445735.594804:0:7982:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789445735.594860:0:7982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445735.594865:0:7982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445735.594867:0:7982:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789445735.594870:0:7982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789445735.594873:0:7982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445735.594875:0:7982:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789445735.594878:0:7982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789445735.594880:0:7982:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789445735.594918:0:7982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c7b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7982:1876369741993088:0@lo:502: 00000100:00100000:1.0:1789445735.594996:0:7982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445735.595036:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741993088 00000100:00100000:1.0:1789445735.595067:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741993088 00000100:00100000:1.0:1789445735.595116:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789445735.595125:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:7982:x1876369741993088:12345-0@lo:502: 00000100:00100000:1.0:1789445735.595373:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:7982:x1876369741993088:12345-0@lo:502: Request processed in 248us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445735.595381:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789445735.595432:0:7982:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4e1f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789445735.595453:0:7982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c7b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:7982:1876369741993088:0@lo:502: 00000020:01000000:1.0:1789445735.595477:0:7982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445735.595481:0:7982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445735.595483:0:7982:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789445735.595486:0:7982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1789445735.595531:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789445735.595547:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789445735.595556:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678800/0xc1b37c4d4725602f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256036 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.595567:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe81678800/0xc1b37c4d4725602f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256036 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445735.595577:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789445735.595580:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9afea4f94d40 from 1 10000000:01000000:1.0:1789445735.595583:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789445735.595605:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678600/0xc1b37c4d47256052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.595612:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe81678600/0xc1b37c4d47256052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.595620:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe81678600/0xc1b37c4d47256052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445735.595633:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741993216:0@lo:101: 00000100:00100000:1.0:1789445735.595667:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445735.595684:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4e1f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789445735.595698:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741993216 00000100:00100000:1.0:1789445735.595702:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741993216 00000100:00100000:1.0:1789445735.595722:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789445735.595729:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369741993216:12345-0@lo:101: 00010000:00010000:1.0:1789445735.595737:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445735.595748:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81679200/0xc1b37c4d47256059 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47256052 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.595769:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81679200/0xc1b37c4d47256059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47256052 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.595778:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81679200/0xc1b37c4d47256059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47256052 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.595787:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81679200, rc 0) 00000100:00100000:1.0:1789445735.595814:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369741993216:12345-0@lo:101: Request processed in 85us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445735.595820:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789445735.595848:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741993216:0@lo:101: 00010000:00010000:1.0:1789445735.595858:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe81678600/0xc1b37c4d47256052 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256059 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.595867:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe81678600/0xc1b37c4d47256052 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47256059 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445735.595906:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741993344:0@lo:501: 00000100:00100000:1.0:1789445735.595937:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445735.595950:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4e1f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789445735.595962:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741993344 00000100:00100000:1.0:1789445735.595966:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741993344 00000100:00100000:1.0:1789445735.595986:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789445735.595992:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369741993344:12345-0@lo:501: 00000100:00100000:1.0:1789445735.596206:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369741993344:12345-0@lo:501: Request processed in 213us (267us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789445735.596213:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789445735.596243:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741993344:0@lo:501: 10000000:01000000:1.0:1789445735.596260:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789445735.596265:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678600/0xc1b37c4d47256052 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256059 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445735.596272:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe81678600/0xc1b37c4d47256052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256059 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445735.596653:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369741992960:0@lo:8: 00000100:00100000:0.0:1789445735.596696:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445735.597716:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741992960 00000100:00100000:1.0:1789445735.597725:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741992960 00000100:00100000:1.0:1789445735.598344:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789445735.598353:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3309:x1876369741992960:12345-0@lo:8: 00010000:00080000:1.0:1789445735.598382:0:6685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:1.0:1789445735.598412:0:6685:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1b37c4d47256060 00002000:00100000:1.0:1789445735.598426:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9afebfa4f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789445735.598430:0:6685:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1789445735.598434:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789445735.598547:0:6685:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789445735.598840:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789445735.598866:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9afebfa4a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789445735.598993:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876369741992960:12345-0@lo:8: Request processed in 639us (2296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445735.599001:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789445735.601572:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb5c78380 x1876369741992960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789445745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445735.601587:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789445735.601597:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789445735.601605:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789445735.601611:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789445735.601615:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afebf739800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789445735.601633:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789445735.601638:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369741992960:0@lo:8: 00000004:00080000:3.0:1789445735.601675:0:7983:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789445735.601795:0:7983:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 173623749608ns, next at 0ns, rc = 0 00000004:00080000:1.0:1789445735.712580:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789445735.783849:0:7985:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789445735.783879:0:7985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7985:1876369741993600:0@lo:7: 00000100:00100000:2.0:1789445735.783954:0:7985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445735.783999:0:7985:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445735.784015:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369741993472:0@lo:13: 00000100:00100000:2.0:1789445735.784038:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445735.784119:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741993472 00000100:00100000:2.0:1789445735.784126:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741993472 00000100:00100000:2.0:1789445735.784174:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789445735.784182:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876369741993472:12345-0@lo:13: 00002000:00000024:2.0:1789445735.784211:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789445735.784252:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876369741993472:12345-0@lo:13: Request processed in 70us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445735.784259:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789445735.784291:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789445735.784341:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4d40a80 x1876369741993472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445735.784360:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369741993472:0@lo:13: 00000100:00100000:1.0:1789445735.785125:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741993600 00000100:00100000:1.0:1789445735.785134:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741993600 00000100:00100000:1.0:1789445735.785176:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789445735.785186:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7985:x1876369741993600:12345-0@lo:7: 00002000:00080000:2.0:1789445735.800364:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1789445735.800371:0:6682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789445735.800463:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7985:x1876369741993600:12345-0@lo:7: Request processed in 15275us (16504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445735.800473:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789445735.804324:0:7985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4d40000 x1876369741993600/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789445751 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445735.804343:0:7985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7985:1876369741993600:0@lo:7: 00000004:00080000:1.0:1789445735.804371:0:7985:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789445735.804865:0:7985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c7b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7985:1876369741993728:0@lo:5: 00000100:00100000:1.0:1789445735.805094:0:7985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445735.805140:0:7985:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8925e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789445735.805160:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741993728 00000100:00100000:1.0:1789445735.805166:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741993728 00000100:00100000:1.0:1789445735.805213:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789445735.805221:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7985:x1876369741993728:12345-0@lo:5: 00002000:00080000:1.0:1789445735.805332:0:6685:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789445735.805336:0:6685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789445735.806348:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7985:x1876369741993728:12345-0@lo:5: Request processed in 1118us (1245us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789445735.806358:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789445735.806479:0:7985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb5c7b800 x1876369741993728/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789445751 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445735.806496:0:7985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c7b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7985:1876369741993728:0@lo:5: 00000004:00080000:0.0:1789445735.806508:0:7985:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789445735.806541:0:7985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7985:1876369741993856:0@lo:700: 00000100:00100000:0.0:1789445735.806571:0:7985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445735.806603:0:7985:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afead97e480 going to sleep for 11 seconds 00000100:00100000:1.0:1789445735.806745:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741993856 00000100:00100000:1.0:1789445735.806751:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741993856 00000100:00100000:1.0:1789445735.806787:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789445735.806795:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7985:x1876369741993856:12345-0@lo:700: 00000100:00100000:1.0:1789445735.806825:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6691:1876369741993984:0@lo:700: 00000100:00100000:1.0:1789445735.806852:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445735.806869:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8925e180 going to sleep for 11 seconds 00000100:00100000:1.0:1789445735.806882:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741993984 00000100:00100000:1.0:1789445735.806886:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741993984 00000100:00100000:1.0:1789445735.806908:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789445735.806914:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6691:x1876369741993984:12345-0@lo:700: 40000000:02000000:2.0:1789445735.857110:0:5847:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1789445735.864212:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6691:x1876369741993984:12345-0@lo:700: Request processed in 57290us (57350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445735.864305:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789445735.868137:0:6691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb5c7ad80 x1876369741993984/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789445751 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445735.868156:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6691:1876369741993984:0@lo:700: 40000000:02000000:2.0:1789445735.868169:0:6691:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1789445735.988341:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1789445735.988355:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789445735.989182:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7985:x1876369741993856:12345-0@lo:700: Request processed in 182382us (182605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445735.989200:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789445735.989292:0:7985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afe9ee7fb80 x1876369741993856/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789445751 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445735.989304:0:7985:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789445735.989319:0:7985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7985:1876369741993856:0@lo:700: 00000004:02000040:0.0:1789445736.036257:0:7985:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1789445736.041495:0:7985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7985:1876369741994112:0@lo:5: 00000100:00100000:0.0:1789445736.041566:0:7985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445736.041761:0:7985:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afead97e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445736.041833:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741994112 00000100:00100000:2.0:1789445736.041840:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741994112 00000100:00100000:2.0:1789445736.042071:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789445736.042092:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7985:x1876369741994112:12345-0@lo:5: 00002000:00080000:2.0:1789445736.050765:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789445736.050785:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789445736.055223:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7985:x1876369741994112:12345-0@lo:5: Request processed in 13128us (13649us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789445736.055237:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789445736.056696:0:7985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afe9ee7fb80 x1876369741994112/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789445752 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445736.056715:0:7985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7985:1876369741994112:0@lo:5: 00000004:00080000:1.0:1789445736.056730:0:7985:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1789445736.156529:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445737.180122:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445738.202680:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445738.597562:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789445738.597584:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369741994240:0@lo:13: 00000100:00100000:0.0:1789445738.597643:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445738.597702:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741994240 00000100:00100000:0.0:1789445738.597709:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741994240 00000100:00100000:0.0:1789445738.597763:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789445738.597772:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369741994240:12345-0@lo:13: 00002000:00000024:0.0:1789445738.597806:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789445738.597911:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369741994240:12345-0@lo:13: Request processed in 77us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445738.597921:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789445738.597942:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789445738.597971:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afe9ee7ed80 x1876369741994240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445738.597988:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369741994240:0@lo:13: 00010000:00010000:3.0:1789445739.229739:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445740.250664:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445740.635500:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741994368:0@lo:400: 00000100:00100000:0.0:1789445740.635570:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445740.635615:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369741994880:0@lo:400: 00000100:00100000:0.0:1789445740.635643:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445740.635667:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789445740.635673:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369741994752:0@lo:400: 00000100:00100000:0.0:1789445740.635694:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445740.635725:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741994368 00000100:00100000:0.0:1789445740.635732:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741994368 00000100:00100000:0.0:1789445740.635775:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789445740.635783:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369741994368:12345-0@lo:400: 00000100:00100000:0.0:1789445740.635828:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369741994368:12345-0@lo:400: Request processed in 45us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445740.635836:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789445740.635886:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741994880 00000100:00100000:0.0:1789445740.635890:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741994880 00000100:00100000:0.0:1789445740.635922:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789445740.635929:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369741994880:12345-0@lo:400: 00000100:00100000:0.0:1789445740.635959:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369741994880:12345-0@lo:400: Request processed in 31us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445740.635966:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789445740.635994:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741994752 00000100:00100000:0.0:1789445740.635998:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741994752 00000100:00100000:0.0:1789445740.636022:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789445740.636028:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369741994752:12345-0@lo:400: 00000100:00100000:0.0:1789445740.636093:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369741994752:12345-0@lo:400: Request processed in 65us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445740.636108:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789445740.636127:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789445740.636131:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789445740.636162:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4d41880 x1876369741994752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445740.636175:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369741994752:0@lo:400: 00000100:00100000:0.0:1789445740.636197:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741994368:0@lo:400: 00010000:00080000:0.0:1789445740.636206:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4d42300 x1876369741994880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445740.636214:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369741994880:0@lo:400: 00000100:00100000:2.0:1789445740.636642:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369741994496:0@lo:400: 00000100:00100000:2.0:1789445740.636677:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445740.636709:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369741995008:0@lo:400: 00000100:00100000:2.0:1789445740.636742:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445740.636770:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789445740.636776:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369741994624:0@lo:400: 00000100:00100000:2.0:1789445740.636799:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445740.636839:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741995008 00000100:00100000:2.0:1789445740.636843:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741995008 00000100:00100000:2.0:1789445740.636888:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789445740.636896:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876369741995008:12345-0@lo:400: 00000100:00100000:2.0:1789445740.636933:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876369741995008:12345-0@lo:400: Request processed in 39us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445740.636940:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789445740.636966:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4d41f80 x1876369741995008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445740.637386:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369741995008:0@lo:400: 00000100:00100000:0.0:1789445740.637966:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741994496 00000100:00100000:0.0:1789445740.638074:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741994496 00000100:00100000:0.0:1789445740.638111:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741994624 00000100:00100000:0.0:1789445740.638115:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741994624 00000100:00100000:0.0:1789445740.638133:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789445740.638139:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369741994496:12345-0@lo:400: 00000100:00100000:0.0:1789445740.638259:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369741994496:12345-0@lo:400: Request processed in 119us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445740.638266:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789445740.638279:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789445740.638286:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369741994624:12345-0@lo:400: 00000100:00100000:0.0:1789445740.638312:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369741994624:12345-0@lo:400: Request processed in 27us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445740.638318:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789445740.638333:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789445740.638343:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789445740.638373:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4d42a00 x1876369741994624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445740.638385:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369741994624:0@lo:400: 00010000:00080000:0.0:1789445740.638534:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4d41c00 x1876369741994496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445740.638544:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369741994496:0@lo:400: 00000001:00080000:0.0:1789445740.797642:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1789445741.146794:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369741995136:0@lo:13: 00000100:00100000:3.0:1789445741.146858:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445741.147565:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741995136 00000100:00100000:0.0:1789445741.147574:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741995136 00000100:00100000:0.0:1789445741.147701:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789445741.147709:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369741995136:12345-0@lo:13: 00002000:00000024:0.0:1789445741.147744:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789445741.150219:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369741995136:12345-0@lo:13: Request processed in 2502us (3352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445741.150233:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789445741.150455:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeba628000 x1876369741995136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445741.150468:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789445741.150503:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369741995136:0@lo:13: 00010000:00010000:0.0:1789445741.275671:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445742.299472:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445742.373581:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445742.373672:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722048896 00000100:00100000:1.0:1789445742.373683:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722048896 00000100:00100000:1.0:1789445742.373733:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 112 00000100:00100000:1.0:1789445742.373741:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2373:x1876369722048896:12345-192.168.206.59@tcp:250: 00010000:00080000:1.0:1789445742.373770:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from eea72feb-e69e-4b1c-9967-d4ce1a915b88@192.168.206.59@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:1.0:1789445742.373800:0:5836:0:(genops.c:1384:class_connect()) connect: client eea72feb-e69e-4b1c-9967-d4ce1a915b88, cookie 0xc1b37c4d47256067 00000100:00080000:1.0:1789445742.373956:0:5836:0:(import.c:65:import_set_state_nolock()) ffff9afebfa49800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789445742.374023:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+5:2373:x1876369722048896:12345-192.168.206.59@tcp:250: Request processed in 281us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445742.374098:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 112 00000100:00100000:3.0:1789445742.380349:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445742.381010:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722048768 00000100:00100000:0.0:1789445742.381021:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722048768 00000100:00100000:0.0:1789445742.381133:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 113 00000100:00100000:0.0:1789445742.381145:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+5:5617:x1876369722048768:12345-192.168.206.59@tcp:101: 00010000:00010000:0.0:1789445742.381161:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445742.381178:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe8e988e00/0xc1b37c4d4725606e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba49f5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445742.381206:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe8e988e00/0xc1b37c4d4725606e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49f5 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445742.381236:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe8e988e00/0xc1b37c4d4725606e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49f5 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445742.381245:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e988e00, rc 0) 00000100:00100000:0.0:1789445742.381304:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+6:5617:x1876369722048768:12345-192.168.206.59@tcp:101: Request processed in 162us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445742.381311:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 113 00000100:00100000:3.0:1789445742.385934:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445742.386083:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722049024 00000100:00100000:0.0:1789445742.386093:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722049024 00000100:00100000:0.0:1789445742.386261:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 114 00000100:00100000:0.0:1789445742.386272:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+6:5617:x1876369722049024:12345-192.168.206.59@tcp:501: 00000100:00100000:0.0:1789445742.386638:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+6:5617:x1876369722049024:12345-192.168.206.59@tcp:501: Request processed in 367us (713us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789445742.386646:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 114 00000100:00100000:3.0:1789445742.389708:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445742.389816:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722049152 00000100:00100000:1.0:1789445742.389827:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722049152 00000100:00100000:1.0:1789445742.389887:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 115 00000100:00100000:1.0:1789445742.389896:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+6:5617:x1876369722049152:12345-192.168.206.59@tcp:101: 00010000:00010000:1.0:1789445742.389912:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445742.389931:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81678000/0xc1b37c4d47256075 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba49fc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445742.389955:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81678000/0xc1b37c4d47256075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49fc expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445742.389966:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81678000/0xc1b37c4d47256075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49fc expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445742.389975:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81678000, rc 0) 00000100:00100000:1.0:1789445742.390027:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+7:5617:x1876369722049152:12345-192.168.206.59@tcp:101: Request processed in 132us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445742.390033:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 115 00000100:00100000:3.0:1789445742.393134:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445742.393281:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722049280 00000100:00100000:1.0:1789445742.393292:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722049280 00000100:00100000:1.0:1789445742.393363:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 116 00000100:00100000:1.0:1789445742.393373:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+7:5617:x1876369722049280:12345-192.168.206.59@tcp:501: 00000100:00100000:1.0:1789445742.393654:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+8:5617:x1876369722049280:12345-192.168.206.59@tcp:501: Request processed in 282us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445742.393663:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 116 00000100:00100000:3.0:1789445742.406193:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445742.406542:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722049408 00000100:00100000:0.0:1789445742.406553:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722049408 00000100:00100000:0.0:1789445742.406611:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 117 00000100:00100000:0.0:1789445742.406621:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+8:5617:x1876369722049408:12345-192.168.206.59@tcp:503: 00000100:00100000:0.0:1789445742.406990:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+8:5617:x1876369722049408:12345-192.168.206.59@tcp:503: Request processed in 369us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445742.406998:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 117 00000100:00100000:3.0:1789445742.423522:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445742.423724:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722049536 00000100:00100000:1.0:1789445742.423748:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722049536 00000100:00100000:1.0:1789445742.423804:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 118 00000100:00100000:1.0:1789445742.423814:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+8:5635:x1876369722049536:12345-192.168.206.59@tcp:502: 00000100:00100000:1.0:1789445742.424212:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+8:5635:x1876369722049536:12345-192.168.206.59@tcp:502: Request processed in 399us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445742.424221:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 118 00000100:00100000:3.0:1789445742.482122:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445742.482230:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722049664 00000100:00100000:2.0:1789445742.482239:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722049664 00000100:00100000:2.0:1789445742.482297:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 119 00000100:00100000:2.0:1789445742.482308:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+8:5635:x1876369722049664:12345-192.168.206.59@tcp:502: 00000100:00100000:2.0:1789445742.482585:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+8:5635:x1876369722049664:12345-192.168.206.59@tcp:502: Request processed in 278us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445742.482593:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 119 00000100:00100000:3.0:1789445742.488749:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445742.489099:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722049792 00000100:00100000:0.0:1789445742.489110:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722049792 00000100:00100000:0.0:1789445742.489167:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 120 00000100:00100000:0.0:1789445742.489176:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+8:5617:x1876369722049792:12345-192.168.206.59@tcp:101: 00010000:00010000:0.0:1789445742.489208:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445742.489226:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe8e988400/0xc1b37c4d4725607c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4a26 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445742.489255:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe8e988400/0xc1b37c4d4725607c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a26 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445742.489266:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe8e988400/0xc1b37c4d4725607c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a26 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445742.489274:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e988400, rc 0) 00000100:00100000:0.0:1789445742.489327:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:5617:x1876369722049792:12345-192.168.206.59@tcp:101: Request processed in 153us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445742.489334:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 120 00000100:00100000:3.0:1789445742.495430:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445742.495675:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722049920 00000100:00100000:2.0:1789445742.495686:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722049920 00000100:00100000:2.0:1789445742.495747:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 121 00000100:00100000:2.0:1789445742.495758:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:5617:x1876369722049920:12345-192.168.206.59@tcp:256: 20000000:01000000:2.0:1789445742.495786:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789445742.495818:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789445742.495822:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789445742.495825:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789445742.495827:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789445742.500133:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:5617:x1876369722049920:12345-192.168.206.59@tcp:256: Request processed in 4367us (4703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445742.500148:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 121 00000100:00100000:3.0:1789445742.519327:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445742.519400:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722050048 00000100:00100000:1.0:1789445742.519429:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722050048 00000100:00100000:1.0:1789445742.519486:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 122 00000100:00100000:1.0:1789445742.519497:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:5617:x1876369722050048:12345-192.168.206.59@tcp:101: 00010000:00010000:1.0:1789445742.519513:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445742.519531:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81679000/0xc1b37c4d47256083 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4a2d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445742.519558:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81679000/0xc1b37c4d47256083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a2d expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445742.519570:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81679000/0xc1b37c4d47256083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a2d expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445742.519578:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81679000, rc 0) 00000100:00100000:1.0:1789445742.519642:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:5617:x1876369722050048:12345-192.168.206.59@tcp:101: Request processed in 146us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445742.519649:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 122 00000100:00100000:3.0:1789445742.539423:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445742.539531:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722050176 00000100:00100000:2.0:1789445742.539541:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722050176 00000100:00100000:2.0:1789445742.539597:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 123 00000100:00100000:2.0:1789445742.539608:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:5617:x1876369722050176:12345-192.168.206.59@tcp:501: 00000100:00100000:2.0:1789445742.539904:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:5617:x1876369722050176:12345-192.168.206.59@tcp:501: Request processed in 298us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445742.539912:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 123 00000100:00100000:3.0:1789445742.543631:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445742.544322:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722050304 00000100:00100000:1.0:1789445742.544334:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722050304 00000100:00100000:1.0:1789445742.544391:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 124 00000100:00100000:1.0:1789445742.544401:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:5617:x1876369722050304:12345-192.168.206.59@tcp:503: 00000100:00100000:1.0:1789445742.544780:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:5617:x1876369722050304:12345-192.168.206.59@tcp:503: Request processed in 375us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445742.544789:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 124 00000100:00100000:3.0:1789445742.547298:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445742.548003:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722050432 00000100:00100000:0.0:1789445742.548014:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722050432 00000100:00100000:0.0:1789445742.548176:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 125 00000100:00100000:0.0:1789445742.548186:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:5639:x1876369722050432:12345-192.168.206.59@tcp:502: 00000100:00100000:0.0:1789445742.548476:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:5639:x1876369722050432:12345-192.168.206.59@tcp:502: Request processed in 291us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445742.548485:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 125 00000100:00100000:3.0:1789445742.552889:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445742.552991:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722050560 00000100:00100000:1.0:1789445742.553001:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722050560 00000100:00100000:1.0:1789445742.553085:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 126 00000100:00100000:1.0:1789445742.553096:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:5639:x1876369722050560:12345-192.168.206.59@tcp:502: 00000100:00100000:1.0:1789445742.553328:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:5639:x1876369722050560:12345-192.168.206.59@tcp:502: Request processed in 233us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445742.553336:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 126 00000100:00100000:3.0:1789445742.556748:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445742.557035:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722050688 00000100:00100000:0.0:1789445742.557077:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722050688 00000100:00100000:0.0:1789445742.557134:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 4 00000100:00100000:0.0:1789445742.557144:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2373:x1876369722050688:12345-192.168.206.59@tcp:38: 00010000:00080000:0.0:1789445742.557174:0:5840:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:0.0:1789445742.557222:0:5840:0:(genops.c:1384:class_connect()) connect: client 4a94602d-5f10-4cb2-abf8-c0de02603d85, cookie 0xc1b37c4d4725608a 00000004:00100000:0.0:1789445742.557264:0:5840:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1789445742.557270:0:5840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1789445742.598838:0:5840:0:(import.c:65:import_set_state_nolock()) ffff9afeba786000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789445742.599103:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2373:x1876369722050688:12345-192.168.206.59@tcp:38: Request processed in 41957us (42361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445742.599114:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 4 00010000:00010000:0.0:1789445743.323131:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445743.613207:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445743.613255:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445743.613463:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722050816 00000100:00100000:1.0:1789445743.613472:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722050816 00000100:00100000:1.0:1789445743.613531:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722050944 00000100:00100000:1.0:1789445743.613534:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722050944 00000100:00100000:1.0:1789445743.613552:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 5 00000100:00100000:1.0:1789445743.613561:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:0:x1876369722050816:12345-192.168.206.59@tcp:41: 00000004:00000024:1.0:1789445743.613601:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789445743.613659:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:0:x1876369722050816:12345-192.168.206.59@tcp:41: Request processed in 98us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445743.613667:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 5 00000100:00100000:1.0:1789445743.613684:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00100000:1.0:1789445743.613690:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:5617:x1876369722050944:12345-192.168.206.59@tcp:41: 00000004:00000024:1.0:1789445743.613701:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789445743.613722:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:5617:x1876369722050944:12345-192.168.206.59@tcp:41: Request processed in 33us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445743.613746:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00080000:1.0:1789445743.613773:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445743.618725:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445743.619085:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722051072 00000100:00100000:1.0:1789445743.619096:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722051072 00000100:00100000:1.0:1789445743.619164:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:1.0:1789445743.619176:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:5617:x1876369722051072:12345-192.168.206.59@tcp:40: 00000100:00100000:1.0:1789445743.619263:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:5617:x1876369722051072:12345-192.168.206.59@tcp:40: Request processed in 90us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445743.619271:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:3.0:1789445743.626540:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445743.626586:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445743.626886:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722051200 00000100:00100000:2.0:1789445743.626895:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722051200 00000100:00100000:2.0:1789445743.626940:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722051328 00000100:00100000:2.0:1789445743.626944:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722051328 00000100:00100000:2.0:1789445743.626957:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 8 00000100:00100000:2.0:1789445743.626965:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2373:x1876369722051200:12345-192.168.206.59@tcp:8: 00010000:00080000:2.0:1789445743.626993:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:2.0:1789445743.627022:0:6682:0:(genops.c:1384:class_connect()) connect: client 4a94602d-5f10-4cb2-abf8-c0de02603d85, cookie 0xc1b37c4d47256091 00002000:00100000:2.0:1789445743.627033:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4a94602d-5f10-4cb2-abf8-c0de02603d85/ffff9afe9f983000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789445743.627090:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789445743.627418:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789445743.627451:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9afe9f981000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789445743.627515:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2373:x1876369722051200:12345-192.168.206.59@tcp:8: Request processed in 550us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445743.627535:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 8 00000100:00100000:2.0:1789445743.627555:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00100000:2.0:1789445743.627560:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2373:x1876369722051328:12345-192.168.206.59@tcp:8: 00010000:00080000:2.0:1789445743.627575:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:2.0:1789445743.627597:0:6682:0:(genops.c:1384:class_connect()) connect: client 4a94602d-5f10-4cb2-abf8-c0de02603d85, cookie 0xc1b37c4d47256098 00002000:00100000:2.0:1789445743.627602:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4a94602d-5f10-4cb2-abf8-c0de02603d85/ffff9afe9f984000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789445743.627615:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789445743.629373:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789445743.629643:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9afe9f982800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789445743.629785:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2373:x1876369722051328:12345-192.168.206.59@tcp:8: Request processed in 2221us (3196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445743.629795:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00100000:3.0:1789445743.633585:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445743.633892:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722051456 00000100:00100000:0.0:1789445743.633901:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722051456 00000100:00100000:0.0:1789445743.633958:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 0 00000100:00100000:0.0:1789445743.633968:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:5617:x1876369722051456:12345-192.168.206.59@tcp:33: 00000100:00100000:1.0:1789445743.640982:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445743.645595:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722051584 00000100:00100000:2.0:1789445743.645611:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722051584 00000100:00100000:2.0:1789445743.645737:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 127 00000100:00100000:2.0:1789445743.645748:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2374:x1876369722051584:12345-192.168.206.59@tcp:400: 00000100:00100000:2.0:1789445743.646446:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2374:x1876369722051584:12345-192.168.206.59@tcp:400: Request processed in 697us (5470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445743.646455:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 127 00000004:00080000:2.0:1789445743.659403:0:5843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 25369us 00000004:00200000:0.0:1789445743.680786:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789445743.680894:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:5617:x1876369722051456:12345-192.168.206.59@tcp:33: Request processed in 46922us (47312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445743.680903:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 0 00000100:00100000:1.0:1789445743.706656:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789445743.706681:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369741995264:0@lo:13: 00000100:00100000:1.0:1789445743.706748:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445743.706989:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741995264 00000100:00100000:0.0:1789445743.706996:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741995264 00000100:00100000:0.0:1789445743.707084:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789445743.707093:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369741995264:12345-0@lo:13: 00002000:00000024:0.0:1789445743.707113:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789445743.707166:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369741995264:12345-0@lo:13: Request processed in 75us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445743.707173:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789445743.707266:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789445743.707452:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeba628e00 x1876369741995264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445743.707469:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369741995264:0@lo:13: 00000100:00100000:1.0:1789445743.897564:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445743.897669:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722051712 00000100:00100000:0.0:1789445743.897679:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722051712 00000100:00100000:0.0:1789445743.897738:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 8 00000100:00100000:0.0:1789445743.897749:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:5656:x1876369722051712:12345-192.168.206.59@tcp:101: 00010000:00010000:0.0:1789445743.897783:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445743.901985:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe81504400/0xc1b37c4d4725609f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4a57 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445743.902156:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe81505000/0xc1b37c4d472560a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445743.902182:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe81505000/0xc1b37c4d472560a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445743.902198:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe81505000/0xc1b37c4d472560a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445743.902234:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789445743.902238:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789445743.902255:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe81505000/0xc1b37c4d472560a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445743.902284:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe81504400/0xc1b37c4d4725609f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a57 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445743.902746:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe81505000/0xc1b37c4d472560a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a57 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445743.902757:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe90eac600) 00010000:00010000:2.0:1789445743.902761:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789445743.902764:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81505000, rc 0) 00000100:00100000:2.0:1789445743.902967:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:5656:x1876369722051712:12345-192.168.206.59@tcp:101: Request processed in 5217us (5410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445743.902976:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 8 00000001:00100000:3.0:1789445744.264359:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4a94602d-5f10-4cb2-abf8-c0de02603d85 00010000:00010000:1.0:1789445744.346309:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445745.371334:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445745.754324:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369741995520:0@lo:400: 00000100:00100000:1.0:1789445745.754393:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445745.754495:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741995392:0@lo:400: 00000100:00100000:3.0:1789445745.754544:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445745.754607:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741995392 00000100:00100000:3.0:1789445745.754614:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741995392 00000100:00100000:3.0:1789445745.754659:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789445745.754668:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369741995392:12345-0@lo:400: 00000100:00100000:3.0:1789445745.754716:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369741995392:12345-0@lo:400: Request processed in 49us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445745.754723:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789445745.754780:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741995392:0@lo:400: 00000100:00100000:3.0:1789445745.754984:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369741995648:0@lo:400: 00000100:00100000:3.0:1789445745.755012:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445745.755179:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741995520 00000100:00100000:0.0:1789445745.755184:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741995520 00000100:00100000:0.0:1789445745.755221:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741995648 00000100:00100000:0.0:1789445745.755225:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741995648 00000100:00100000:0.0:1789445745.755249:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789445745.755256:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369741995520:12345-0@lo:400: 00000100:00100000:3.0:1789445745.755324:0:5841:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789445745.755332:0:5841:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789445745.755435:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789445745.755442:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369741995648:12345-0@lo:400: 00000100:00100000:3.0:1789445745.755479:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369741995648:12345-0@lo:400: Request processed in 38us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445745.755486:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789445745.755518:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369741995648:0@lo:400: 00000100:00080000:3.0:1789445745.755645:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445745.759967:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789445745.759993:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369741995776:0@lo:400: 00000100:00100000:2.0:1789445745.760108:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445745.760223:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789445745.760232:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369741995904:0@lo:400: 00000100:00100000:3.0:1789445745.760276:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445745.760326:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741995904 00000100:00100000:3.0:1789445745.760335:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741995904 00000100:00100000:3.0:1789445745.760401:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789445745.760410:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876369741995904:12345-0@lo:400: 00000100:00100000:3.0:1789445745.760490:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876369741995904:12345-0@lo:400: Request processed in 75us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445745.760497:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1789445745.760526:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445745.760559:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369741995904:0@lo:400: 00000100:00100000:3.0:1789445745.760603:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789445745.760615:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369741996032:0@lo:400: 00000100:00100000:2.0:1789445745.760901:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445745.760925:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741995776 00000100:00100000:2.0:1789445745.760935:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741995776 00000100:00100000:2.0:1789445745.760969:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741996032 00000100:00100000:2.0:1789445745.760972:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741996032 00000100:00100000:2.0:1789445745.760988:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789445745.760995:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369741995776:12345-0@lo:400: 00000100:00100000:2.0:1789445745.761066:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369741995776:12345-0@lo:400: Request processed in 50us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445745.761073:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789445745.761087:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789445745.761093:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369741996032:12345-0@lo:400: 00000100:00100000:2.0:1789445745.761126:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369741996032:12345-0@lo:400: Request processed in 33us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445745.761132:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789445745.761160:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4d40000 x1876369741995776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445745.761169:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369741995776:0@lo:400: 00010000:00080000:2.0:1789445745.761192:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afe9192ed80 x1876369741996032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445745.761199:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369741996032:0@lo:400: 00000100:00080000:2.0:1789445745.761214:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789445745.761217:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789445745.761379:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369741995520:12345-0@lo:400: Request processed in 6121us (6984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445745.761387:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789445745.761629:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369741995520:0@lo:400: 00000100:00100000:3.0:1789445746.192932:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445746.193203:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722051840 00000100:00100000:0.0:1789445746.193212:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722051840 00000100:00100000:0.0:1789445746.193341:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00100000:0.0:1789445746.193353:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:5709:x1876369722051840:12345-192.168.206.59@tcp:41: 00000004:00000024:0.0:1789445746.193406:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789445746.193471:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:5709:x1876369722051840:12345-192.168.206.59@tcp:41: Request processed in 120us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445746.193479:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00080000:3.0:1789445746.195823:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445746.197815:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445746.197973:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722051968 00000100:00100000:0.0:1789445746.197983:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722051968 00000100:00100000:0.0:1789445746.198333:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 8 00000100:00100000:0.0:1789445746.198345:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:5709:x1876369722051968:12345-192.168.206.59@tcp:13: 00002000:00000024:0.0:1789445746.198397:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789445746.198582:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:5709:x1876369722051968:12345-192.168.206.59@tcp:13: Request processed in 239us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445746.198590:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 8 00000100:00080000:3.0:1789445746.199066:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789445746.200794:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445746.200940:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722052096 00000100:00100000:2.0:1789445746.200949:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722052096 00000100:00100000:2.0:1789445746.201091:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00100000:2.0:1789445746.201101:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:5709:x1876369722052096:12345-192.168.206.59@tcp:13: 00002000:00000024:2.0:1789445746.201137:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789445746.201215:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:5709:x1876369722052096:12345-192.168.206.59@tcp:13: Request processed in 116us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445746.201223:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00080000:3.0:1789445746.202714:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789445746.266584:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369741996160:0@lo:13: 00000100:00100000:0.0:1789445746.266680:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445746.266809:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741996160 00000100:00100000:3.0:1789445746.266817:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741996160 00000100:00100000:3.0:1789445746.266865:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789445746.266875:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369741996160:12345-0@lo:13: 00002000:00000024:3.0:1789445746.266895:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789445746.268349:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369741996160:12345-0@lo:13: Request processed in 1469us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445746.268361:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789445746.268983:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4d40000 x1876369741996160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445746.269007:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369741996160:0@lo:13: 00010000:00010000:1.0:1789445746.394781:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789445746.847510:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4a94602d-5f10-4cb2-abf8-c0de02603d85 00010000:00010000:3.0:1789445747.420129:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789445747.832419:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4a94602d-5f10-4cb2-abf8-c0de02603d85 00010000:00010000:1.0:1789445748.443765:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789445748.710258:0:8292:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1789445748.771977:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445748.772027:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445748.772188:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445748.772239:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445748.772266:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722052224 00000100:00100000:1.0:1789445748.772274:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722052224 00000100:00100000:1.0:1789445748.772315:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 129 00000100:00100000:1.0:1789445748.772324:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2376:x1876369722052224:12345-192.168.206.59@tcp:400: 00000100:00100000:1.0:1789445748.772401:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2376:x1876369722052224:12345-192.168.206.59@tcp:400: Request processed in 77us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445748.772408:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 129 00000100:00100000:1.0:1789445748.772439:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722052608 00000100:00100000:1.0:1789445748.772443:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722052608 00000100:00100000:1.0:1789445748.772469:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722052480 00000100:00100000:1.0:1789445748.772472:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722052480 00000100:00100000:1.0:1789445748.772486:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00100000:1.0:1789445748.772492:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2376:x1876369722052608:12345-192.168.206.59@tcp:400: 00000100:00100000:1.0:1789445748.772519:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2376:x1876369722052608:12345-192.168.206.59@tcp:400: Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445748.772525:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00100000:1.0:1789445748.772536:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:1.0:1789445748.772542:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2376:x1876369722052480:12345-192.168.206.59@tcp:400: 00000100:00100000:1.0:1789445748.772563:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2376:x1876369722052480:12345-192.168.206.59@tcp:400: Request processed in 22us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445748.772569:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00080000:3.0:1789445748.772782:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789445748.772787:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789445748.773031:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722052352 00000100:00100000:2.0:1789445748.773036:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722052352 00000100:00100000:2.0:1789445748.773103:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 22 00000100:00100000:2.0:1789445748.773110:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2376:x1876369722052352:12345-192.168.206.59@tcp:400: 00000100:00100000:2.0:1789445748.773147:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2376:x1876369722052352:12345-192.168.206.59@tcp:400: Request processed in 38us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445748.773154:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 22 00000100:00080000:3.0:1789445748.773230:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445748.828471:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369741996288:0@lo:13: 00000100:00100000:3.0:1789445748.828537:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445748.828647:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741996288 00000100:00100000:1.0:1789445748.828655:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741996288 00000100:00100000:1.0:1789445748.828713:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789445748.828722:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369741996288:12345-0@lo:13: 00002000:00000024:1.0:1789445748.828764:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445748.828811:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369741996288:12345-0@lo:13: Request processed in 90us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445748.828817:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789445748.828926:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789445748.828961:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb5c79180 x1876369741996288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445748.828978:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369741996288:0@lo:13: 00010000:00010000:0.0:1789445749.467311:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445750.491408:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445750.874305:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369741996544:0@lo:400: 00000100:00100000:1.0:1789445750.874395:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445750.874455:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369741997056:0@lo:400: 00000100:00100000:1.0:1789445750.874483:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445750.874518:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789445750.874524:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369741996672:0@lo:400: 00000100:00100000:1.0:1789445750.874546:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445750.874580:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741997056 00000100:00100000:1.0:1789445750.874591:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741997056 00000100:00100000:1.0:1789445750.874656:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789445750.874667:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5758e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369741997056:12345-0@lo:400: 00000100:00100000:1.0:1789445750.874727:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5758e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369741997056:12345-0@lo:400: Request processed in 63us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445750.874735:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789445750.874759:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741996544 00000100:00100000:1.0:1789445750.874763:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741996544 00000100:00100000:1.0:1789445750.874790:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741996672 00000100:00100000:1.0:1789445750.874793:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741996672 00000100:00100000:1.0:1789445750.874814:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789445750.874821:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369741996544:12345-0@lo:400: 00000100:00100000:1.0:1789445750.874853:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369741996544:12345-0@lo:400: Request processed in 32us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445750.874881:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789445750.874904:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789445750.874909:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369741996672:12345-0@lo:400: 00000100:00100000:1.0:1789445750.874938:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369741996672:12345-0@lo:400: Request processed in 29us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445750.874959:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789445750.875142:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369741996672:0@lo:400: 00000100:00100000:1.0:1789445750.875154:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369741996544:0@lo:400: 00010000:00080000:1.0:1789445750.875166:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb5759500 x1876369741997056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445750.875177:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369741997056:0@lo:400: 00000100:00100000:3.0:1789445750.875403:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369741996800:0@lo:400: 00000100:00100000:3.0:1789445750.875443:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445750.875478:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789445750.875484:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369741996416:0@lo:400: 00000100:00100000:3.0:1789445750.875513:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445750.875540:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369741996928:0@lo:400: 00000100:00100000:3.0:1789445750.875564:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789445750.875589:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789445750.875595:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789445750.875606:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741996800 00000100:00100000:3.0:1789445750.875610:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741996800 00000100:00100000:3.0:1789445750.875648:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789445750.875656:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369741996800:12345-0@lo:400: 00000100:00100000:3.0:1789445750.875697:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369741996800:12345-0@lo:400: Request processed in 43us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445750.875703:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789445750.875723:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741996416 00000100:00100000:3.0:1789445750.875727:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741996416 00000100:00100000:3.0:1789445750.875752:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789445750.875760:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3310:x1876369741996416:12345-0@lo:400: 00000100:00100000:3.0:1789445750.875789:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3310:x1876369741996416:12345-0@lo:400: Request processed in 31us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445750.875794:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1789445750.875819:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445750.875850:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369741996416:0@lo:400: 00010000:00080000:3.0:1789445750.875861:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb5759180 x1876369741996800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445750.875872:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369741996800:0@lo:400: 00000100:00100000:3.0:1789445750.875895:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741996928 00000100:00100000:3.0:1789445750.875899:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741996928 00000100:00100000:3.0:1789445750.875931:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789445750.875938:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876369741996928:12345-0@lo:400: 00000100:00100000:3.0:1789445750.876083:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876369741996928:12345-0@lo:400: Request processed in 146us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445750.876091:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789445750.876108:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445750.876124:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369741996928:0@lo:400: 00000100:00100000:3.0:1789445751.386387:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789445751.386434:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369741997184:0@lo:13: 00000100:00100000:3.0:1789445751.386768:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445751.390800:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741997184 00000100:00100000:0.0:1789445751.390823:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741997184 00000100:00100000:3.0:1789445751.390938:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789445751.390956:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369741997184:12345-0@lo:13: 00002000:00000024:3.0:1789445751.391018:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789445751.391145:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369741997184:12345-0@lo:13: Request processed in 195us (4377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445751.391152:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789445751.395858:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afe9192d880 x1876369741997184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445751.395895:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369741997184:0@lo:13: 00010000:00010000:0.0:1789445751.514502:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789445752.113697:0:8440:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcdc3f0210 20000000:00000080:1.0:1789445752.113723:0:8440:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9afe9f91ec00 uarg=0000000000000000 20000000:01000000:1.0:1789445752.113861:0:8440:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789445752.113864:0:8440:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789445752.113866:0:8440:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789445752.113872:0:8440:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789445752.113879:0:8440:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789445752.113897:0:8440:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789445752.113901:0:8440:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789445752.114990:0:8440:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789445752.115009:0:8440:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789445752.116258:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789445752.117161:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789445752.117239:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1789445752.117271:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1789445752.117284:0:8440:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789445752.117286:0:8440:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789445752.118733:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1789445752.119880:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1789445752.120036:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1789445752.120261:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1789445752.120281:0:8440:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789445752.120285:0:8440:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789445752.121297:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1789445752.121892:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1789445752.121963:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1789445752.122014:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1789445752.122031:0:8440:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789445752.122033:0:8440:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789445752.123684:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1789445752.124287:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1789445752.124376:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1789445752.124419:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1789445752.124440:0:8440:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789445752.124468:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.124491:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255faa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255fa3 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.124500:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255fd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255fcd expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.124508:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe81678e00/0xc1b37c4d47255ffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255ff7 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.124515:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe8e989400/0xc1b37c4d4725600c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47256005 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.124522:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe81679c00/0xc1b37c4d4725601a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47256013 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.124529:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d4725602f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.124536:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe81679200/0xc1b37c4d47256059 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47256052 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.124547:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe8e988e00/0xc1b37c4d4725606e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49f5 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.124570:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe81678000/0xc1b37c4d47256075 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49fc expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.124579:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560ad lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.124628:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe81678000/0xc1b37c4d47256075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49fc expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.124648:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afe81678000/0xc1b37c4d47256075 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49fc expref: 9 pid: 5836 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445752.124668:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741997312:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789445752.124811:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe8e988e00/0xc1b37c4d4725606e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49f5 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.124821:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afe8e988e00/0xc1b37c4d4725606e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49f5 expref: 9 pid: 5834 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445752.124831:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741997440:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789445752.124866:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe81679200/0xc1b37c4d47256059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47256052 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.124876:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe81679200/0xc1b37c4d47256059 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47256052 expref: 18 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445752.124886:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741997568:0@lo:104: 00000100:00100000:3.0:1789445752.124937:0:8440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789445752.124993:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d4725602f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.125016:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256036 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d4725602f expref: 18 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445752.125025:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741997696:0@lo:104: 00000100:00100000:3.0:1789445752.125082:0:8440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445752.125130:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789445752.125145:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741997568 00000100:00100000:3.0:1789445752.125154:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741997568 00000100:00100000:3.0:1789445752.125209:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741997696 00000100:00100000:3.0:1789445752.125212:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741997696 00000100:00100000:3.0:1789445752.125229:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789445752.125239:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+4:8440:x1876369741997568:12345-0@lo:104: 00010000:00010000:3.0:1789445752.125254:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe81678600/0xc1b37c4d47256052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47256059 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.125306:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789445752.125312:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+4:8440:x1876369741997568:12345-0@lo:104: Request processed in 75us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445752.125319:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789445752.125339:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789445752.125345:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5af9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:8440:x1876369741997696:12345-0@lo:104: 00010000:00010000:3.0:1789445752.125353:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe81678800/0xc1b37c4d4725602f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47256036 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.125384:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789445752.125390:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5af9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:8440:x1876369741997696:12345-0@lo:104: Request processed in 45us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445752.125402:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789445752.125474:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe81679c00/0xc1b37c4d4725601a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47256013 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.125482:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe81679c00/0xc1b37c4d4725601a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47256013 expref: 18 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445752.125490:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741997824:0@lo:104: 00000100:00100000:3.0:1789445752.125514:0:8440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445752.125534:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741997824 00000100:00100000:3.0:1789445752.125538:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741997824 00000100:00100000:3.0:1789445752.125562:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789445752.125568:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:8440:x1876369741997824:12345-0@lo:104: 00010000:00010000:3.0:1789445752.125575:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47256013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d4725601a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.125602:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789445752.125607:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:8440:x1876369741997824:12345-0@lo:104: Request processed in 40us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445752.125613:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789445752.125640:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe8e989400/0xc1b37c4d4725600c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47256005 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.125649:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe8e989400/0xc1b37c4d4725600c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47256005 expref: 18 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445752.125658:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741997952:0@lo:104: 00000100:00100000:3.0:1789445752.125679:0:8440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445752.125707:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741997952 00000100:00100000:3.0:1789445752.125712:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741997952 00000100:00100000:3.0:1789445752.125736:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789445752.125742:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:8440:x1876369741997952:12345-0@lo:104: 00010000:00010000:3.0:1789445752.125750:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47256005 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d4725600c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.125752:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789445752.125764:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81678600/0xc1b37c4d47256052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47256059 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.125775:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81678600 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1789445752.125780:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81678600/0xc1b37c4d47256052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47256059 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.125784:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789445752.125790:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:8440:x1876369741997952:12345-0@lo:104: Request processed in 49us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445752.125802:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1789445752.125804:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81678600/0xc1b37c4d47256052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47256059 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789445752.125814:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81678600/0xc1b37c4d47256052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47256059 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445752.125821:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789445752.125833:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe81678e00/0xc1b37c4d47255ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255ff7 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.125844:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe81678e00/0xc1b37c4d47255ffe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255ff7 expref: 18 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445752.125854:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741998080:0@lo:104: 00010000:00010000:0.0:1789445752.125855:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe81678600/0xc1b37c4d47256052 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47256059 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.125864:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789445752.125879:0:8440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789445752.125890:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81678600/0xc1b37c4d47256052 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47256059 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.125905:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81678600/0xc1b37c4d47256052 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47256059 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.125910:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255fcd expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.125921:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255fd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255fcd expref: 18 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.125922:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789445752.125928:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81678800/0xc1b37c4d4725602f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47256036 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445752.125935:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741998336:0@lo:104: 00010000:00010000:0.0:1789445752.125937:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81678800 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1789445752.125943:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81678800/0xc1b37c4d4725602f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47256036 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.125951:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81678800/0xc1b37c4d4725602f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47256036 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789445752.125957:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81678800/0xc1b37c4d4725602f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47256036 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445752.125966:0:8440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1789445752.125967:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789445752.125989:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741998080 00000100:00100000:3.0:1789445752.125994:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741998080 00010000:00010000:0.0:1789445752.126010:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe81678800/0xc1b37c4d4725602f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47256036 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.126017:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789445752.126024:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741998336 00010000:00010000:0.0:1789445752.126026:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81678800/0xc1b37c4d4725602f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47256036 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445752.126035:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741998336 00010000:00010000:0.0:1789445752.126036:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81678800/0xc1b37c4d4725602f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47256036 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445752.126083:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789445752.126089:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+4:8440:x1876369741998080:12345-0@lo:104: 00010000:00010000:3.0:1789445752.126097:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe813fce00/0xc1b37c4d47255ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255ffe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.126127:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789445752.126132:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+4:8440:x1876369741998080:12345-0@lo:104: Request processed in 44us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445752.126138:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789445752.126151:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789445752.126156:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:8440:x1876369741998336:12345-0@lo:104: 00010000:00010000:3.0:1789445752.126163:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe81678a00/0xc1b37c4d47255fcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255fd4 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.126189:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789445752.126194:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:8440:x1876369741998336:12345-0@lo:104: Request processed in 39us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445752.126200:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1789445752.126227:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255fa3 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.126236:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255faa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255fa3 expref: 18 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445752.126245:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741998592:0@lo:104: 00000100:00100000:3.0:1789445752.126283:0:8440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445752.126306:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741998592 00000100:00100000:3.0:1789445752.126310:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741998592 00000100:00100000:3.0:1789445752.126336:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789445752.126342:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:8440:x1876369741998592:12345-0@lo:104: 00010000:00010000:3.0:1789445752.126350:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255faa expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.126379:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789445752.126384:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:8440:x1876369741998592:12345-0@lo:104: Request processed in 43us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445752.126389:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789445752.126409:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe85da7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789445752.126439:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741997568:0@lo:104: 00000100:00100000:3.0:1789445752.126450:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741997696:0@lo:104: 00000100:00100000:3.0:1789445752.126458:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741997824:0@lo:104: 00000100:00100000:3.0:1789445752.126465:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741997952:0@lo:104: 00000100:00100000:3.0:1789445752.126471:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741998080:0@lo:104: 00000100:00100000:3.0:1789445752.126477:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741998336:0@lo:104: 00010000:00010000:0.0:1789445752.126482:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000100:00100000:3.0:1789445752.126486:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741998592:0@lo:104: 00010000:00010000:0.0:1789445752.126494:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47256013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d4725601a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.126503:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc200 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1789445752.126507:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47256013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d4725601a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.126514:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47256013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d4725601a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789445752.126521:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47256013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d4725601a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445752.126526:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789445752.126537:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741998464:0@lo:103: 00010000:00010000:0.0:1789445752.126547:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47256013 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d4725601a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.126554:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789445752.126572:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445752.126595:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789445752.126602:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba62b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741998208:0@lo:103: 00000100:00100000:3.0:1789445752.126621:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789445752.126647:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789445752.126817:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47256013 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d4725601a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.126826:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe813fc200/0xc1b37c4d47256013 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d4725601a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.126839:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789445752.126843:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe813fce00/0xc1b37c4d47255ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255ffe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.126899:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fce00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1789445752.126904:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe813fce00/0xc1b37c4d47255ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255ffe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.126923:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe813fce00/0xc1b37c4d47255ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255ffe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789445752.126929:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe813fce00/0xc1b37c4d47255ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255ffe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445752.126935:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789445752.126952:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe813fce00/0xc1b37c4d47255ff7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255ffe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.126958:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789445752.126964:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe813fce00/0xc1b37c4d47255ff7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255ffe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.126971:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe813fce00/0xc1b37c4d47255ff7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255ffe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.126993:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789445752.126996:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81678a00/0xc1b37c4d47255fcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255fd4 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.127012:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81678a00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1789445752.127015:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81678a00/0xc1b37c4d47255fcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255fd4 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.127021:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81678a00/0xc1b37c4d47255fcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255fd4 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789445752.127027:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81678a00/0xc1b37c4d47255fcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255fd4 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445752.127039:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789445752.127213:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741998464 00000100:00100000:1.0:1789445752.127226:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741998464 00010000:00010000:1.0:1789445752.127252:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256036 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d4725602f expref: 19 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445752.127279:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741998208 00000100:00100000:1.0:1789445752.127282:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741998208 00010000:00010000:1.0:1789445752.127293:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe81679200/0xc1b37c4d47256059 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47256052 expref: 20 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.127309:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe81678a00/0xc1b37c4d47255fcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255fd4 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445752.127316:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789445752.127323:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789445752.127328:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf761180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+20:3311:x1876369741998464:12345-0@lo:103: 00010000:00010000:1.0:1789445752.127340:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445752.127342:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81678a00/0xc1b37c4d47255fcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255fd4 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445752.127347:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256036 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d4725602f expref: 20 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.127356:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81678a00/0xc1b37c4d47255fcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255fd4 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445752.127375:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d4725602f expref: 20 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445752.127392:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256036 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d4725602f expref: 20 pid: 5834 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445752.127407:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445752.127444:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf761180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369741998464:12345-0@lo:103: Request processed in 119us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445752.127451:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789445752.127468:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789445752.127474:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf763100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:3311:x1876369741998208:12345-0@lo:103: 00010000:00010000:1.0:1789445752.127481:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445752.127485:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe81679200/0xc1b37c4d47256059 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47256052 expref: 18 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445752.127503:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe81679200/0xc1b37c4d47256059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47256052 expref: 18 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445752.127518:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81679200/0xc1b37c4d47256059 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47256052 expref: 18 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.127518:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445752.127524:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255faa expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445752.127534:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789445752.127535:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fd200 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1789445752.127540:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255faa expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.127548:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255faa expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789445752.127556:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255faa expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445752.127562:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf763100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:3311:x1876369741998208:12345-0@lo:103: Request processed in 86us (937us total) trans 0 rc 0/0 10000000:01000000:0.0:1789445752.127567:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789445752.127574:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1789445752.127759:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255fa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255faa expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.127766:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789445752.127778:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255fa3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255faa expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.127785:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe813fd200/0xc1b37c4d47255fa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255faa expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.127853:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445752.127855:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445752.127858:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445752.127879:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369741998720:0@lo:103: 00000100:00100000:0.0:1789445752.127916:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445752.127956:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789445752.127962:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369741998848:0@lo:103: 00000100:00100000:0.0:1789445752.128475:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445752.128516:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369741998976:0@lo:103: 00000100:00100000:0.0:1789445752.128540:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445752.128561:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789445752.128566:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369741999104:0@lo:103: 00000100:00100000:2.0:1789445752.128794:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741998720 00000100:00100000:2.0:1789445752.128803:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741998720 00010000:00010000:2.0:1789445752.128849:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe81679c00/0xc1b37c4d4725601a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47256013 expref: 17 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445752.128870:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741998848 00000100:00100000:2.0:1789445752.128884:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741998848 00010000:00010000:2.0:1789445752.128899:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe81678e00/0xc1b37c4d47255ffe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255ff7 expref: 18 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445752.128924:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741998976 00000100:00100000:2.0:1789445752.128927:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741998976 00010000:00010000:2.0:1789445752.128945:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255fd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255fcd expref: 19 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445752.128954:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445752.128962:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741999104 00000100:00100000:2.0:1789445752.128967:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741999104 00010000:00010000:2.0:1789445752.128980:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255faa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255fa3 expref: 20 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445752.128995:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789445752.129015:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba628380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+20:3312:x1876369741998720:12345-0@lo:103: 00010000:00010000:2.0:1789445752.129028:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445752.129034:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe81679c00/0xc1b37c4d4725601a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47256013 expref: 20 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.129062:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe81679c00/0xc1b37c4d4725601a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47256013 expref: 20 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.129080:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81679c00/0xc1b37c4d4725601a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47256013 expref: 20 pid: 5836 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.129095:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445752.129139:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba628380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3312:x1876369741998720:12345-0@lo:103: Request processed in 126us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445752.129146:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789445752.129163:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789445752.129176:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:3312:x1876369741998848:12345-0@lo:103: 00010000:00010000:2.0:1789445752.129185:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445752.129190:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe81678e00/0xc1b37c4d47255ffe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255ff7 expref: 18 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.129197:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe81678e00/0xc1b37c4d47255ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255ff7 expref: 18 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.129206:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81678e00/0xc1b37c4d47255ffe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255ff7 expref: 18 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.129213:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445752.129235:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:3312:x1876369741998848:12345-0@lo:103: Request processed in 61us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445752.129241:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789445752.129254:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789445752.129260:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:3310:x1876369741998976:12345-0@lo:103: 00000100:00100000:0.0:1789445752.129263:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1789445752.129273:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789445752.129277:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:3310:x1876369741999104:12345-0@lo:103: 00010000:00010000:2.0:1789445752.129282:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255fd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255fcd expref: 16 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.129289:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445752.129294:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255fcd expref: 16 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.129298:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255faa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255fa3 expref: 16 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.129312:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47255fd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255fcd expref: 16 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.129314:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255fa3 expref: 16 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.129338:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789445752.129338:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe813fda00/0xc1b37c4d47255faa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255fa3 expref: 15 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.129357:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445752.129389:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:3310:x1876369741998976:12345-0@lo:103: Request processed in 129us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445752.129407:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789445752.129441:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:3310:x1876369741999104:12345-0@lo:103: Request processed in 168us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445752.129447:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789445752.129486:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369741998848:0@lo:103: 00000100:00100000:0.0:1789445752.129494:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369741998720:0@lo:103: 00000100:00100000:0.0:1789445752.129520:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369741999104:0@lo:103: 00000100:00100000:0.0:1789445752.129527:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369741998976:0@lo:103: 00000100:00100000:0.0:1789445752.129550:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba62b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741998208:0@lo:103: 00000100:00100000:0.0:1789445752.129559:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369741998464:0@lo:103: 00010000:00010000:3.0:1789445752.133478:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445752.133486:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445752.133489:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445752.133550:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47256005 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d4725600c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.133566:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81505400 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1789445752.134978:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47256005 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d4725600c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.135011:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47256005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d4725600c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789445752.135020:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47256005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d4725600c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445752.135026:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789445752.135403:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445752.135494:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722052736 00000100:00100000:2.0:1789445752.135507:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722052736 00010000:00010000:0.0:1789445752.135528:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47256005 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d4725600c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.135538:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789445752.135563:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe81678000/0xc1b37c4d47256075 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49fc expref: 10 pid: 5836 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.135565:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47256005 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d4725600c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445752.135603:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 18 00000100:00100000:2.0:1789445752.135616:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe919b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2374:x1876369722052736:12345-192.168.206.59@tcp:103: 00010000:00010000:2.0:1789445752.135631:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445752.135638:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe81678000/0xc1b37c4d47256075 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49fc expref: 10 pid: 5836 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.135653:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe81678000/0xc1b37c4d47256075 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49fc expref: 10 pid: 5836 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.135675:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789445752.135705:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81505400/0xc1b37c4d47256005 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d4725600c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.135729:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445752.135731:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445752.135734:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445752.135748:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe919b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2374:x1876369722052736:12345-192.168.206.59@tcp:103: Request processed in 134us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445752.135753:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369741999232:0@lo:103: 00000100:00100000:2.0:1789445752.135761:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 18 00000100:00100000:0.0:1789445752.136017:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789445752.136269:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81678000/0xc1b37c4d47256075 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49fc expref: 9 pid: 5836 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445752.136284:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741997312:192.168.206.59@tcp:104: 00000100:00100000:1.0:1789445752.136844:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741999232 00000100:00100000:1.0:1789445752.136853:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741999232 00010000:00010000:1.0:1789445752.136885:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe8e989400/0xc1b37c4d4725600c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47256005 expref: 13 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445752.136926:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789445752.136935:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:3312:x1876369741999232:12345-0@lo:103: 00010000:00010000:1.0:1789445752.136947:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445752.136952:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe8e989400/0xc1b37c4d4725600c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47256005 expref: 13 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445752.136962:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe8e989400/0xc1b37c4d4725600c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47256005 expref: 13 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445752.136980:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe8e989400/0xc1b37c4d4725600c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47256005 expref: 13 pid: 5835 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445752.137012:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445752.137273:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:3312:x1876369741999232:12345-0@lo:103: Request processed in 338us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445752.137280:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789445752.137440:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369741999232:0@lo:103: 00000100:00100000:1.0:1789445752.143919:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445752.144035:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1876369741997440:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789445752.144123:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445752.145129:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722052864 00000100:00100000:2.0:1789445752.145141:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722052864 00010000:00010000:2.0:1789445752.145188:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe8e988e00/0xc1b37c4d4725606e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49f5 expref: 9 pid: 5834 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445752.145236:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 20 00000100:00100000:2.0:1789445752.145246:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5759500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:2374:x1876369722052864:12345-192.168.206.59@tcp:103: 00010000:00010000:2.0:1789445752.145281:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445752.145287:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe8e988e00/0xc1b37c4d4725606e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49f5 expref: 9 pid: 5834 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.145300:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe8e988e00/0xc1b37c4d4725606e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49f5 expref: 9 pid: 5834 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.145320:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe8e988e00/0xc1b37c4d4725606e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba49f5 expref: 9 pid: 5834 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.145338:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560ad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.145348:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560ad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.145377:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.145385:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.145392:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560ad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.145401:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.145408:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fcc00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445752.145420:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.145439:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560ad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.145458:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560ad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445752.145468:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445752.145535:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5759500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+8:2374:x1876369722052864:12345-192.168.206.59@tcp:103: Request processed in 289us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445752.145544:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 20 00010000:00010000:3.0:1789445752.145987:0:8440:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.145998:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445752.146015:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560ad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445752.540593:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445753.562298:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789445753.626223:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789445753.626230:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afebb4dd000 from 39 10000000:01000000:1.0:1789445753.626235:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789445753.626288:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d472560b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.626300:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d472560b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.626311:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d472560b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445753.626338:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741999360:0@lo:101: 00000100:00100000:1.0:1789445753.626403:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445753.626469:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb53e2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789445753.626535:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741999360 00000100:00100000:3.0:1789445753.626544:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741999360 00000100:00100000:3.0:1789445753.626594:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789445753.626604:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+12:5838:x1876369741999360:12345-0@lo:101: 00010000:00010000:3.0:1789445753.626618:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445753.626631:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472560b4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445753.626675:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472560b4 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445753.626686:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472560b4 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445753.626707:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fcc00, rc 0) 00000100:00100000:3.0:1789445753.626753:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:5838:x1876369741999360:12345-0@lo:101: Request processed in 151us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445753.626760:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789445753.626965:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741999360:0@lo:101: 00010000:00010000:1.0:1789445753.626984:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d472560b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.627001:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d472560b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472560bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445753.627072:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741999488:0@lo:501: 00000100:00100000:1.0:1789445753.627097:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445753.627126:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb53e2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789445753.627185:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741999488 00000100:00100000:3.0:1789445753.627189:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741999488 00000100:00100000:3.0:1789445753.627223:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789445753.627231:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:5838:x1876369741999488:12345-0@lo:501: 00000100:00100000:3.0:1789445753.627478:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:5838:x1876369741999488:12345-0@lo:501: Request processed in 248us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445753.627485:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789445753.627659:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741999488:0@lo:501: 00000100:00100000:2.0:1789445753.627688:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741999616:0@lo:503: 00000100:00100000:2.0:1789445753.627725:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445753.627750:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb5485180 going to sleep for 11 seconds 00000100:00100000:3.0:1789445753.627906:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741999616 00000100:00100000:3.0:1789445753.627911:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741999616 00000100:00100000:3.0:1789445753.627930:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789445753.627936:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:5838:x1876369741999616:12345-0@lo:503: 00000100:00100000:3.0:1789445753.628111:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:5838:x1876369741999616:12345-0@lo:503: Request processed in 175us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445753.628117:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789445753.628189:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369741999616:0@lo:503: 00000100:00100000:0.0:1789445753.628804:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8457:1876369741999744:0@lo:502: 00000100:00100000:0.0:1789445753.628847:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445753.628883:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf9fb240 going to sleep for 11 seconds 00000100:00100000:3.0:1789445753.629080:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741999744 00000100:00100000:3.0:1789445753.629086:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741999744 00000100:00100000:3.0:1789445753.629121:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789445753.629129:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:8457:x1876369741999744:12345-0@lo:502: 00000100:00100000:3.0:1789445753.629324:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:8457:x1876369741999744:12345-0@lo:502: Request processed in 195us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445753.629331:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789445753.629500:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8457:1876369741999744:0@lo:502: 00000100:00100000:0.0:1789445753.629539:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8457:1876369741999872:0@lo:502: 00000100:00100000:0.0:1789445753.629568:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445753.629593:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf9fb240 going to sleep for 11 seconds 00000100:00100000:3.0:1789445753.629639:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369741999872 00000100:00100000:3.0:1789445753.629643:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369741999872 00000100:00100000:3.0:1789445753.629782:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789445753.629790:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:8457:x1876369741999872:12345-0@lo:502: 00000100:00100000:3.0:1789445753.629927:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:8457:x1876369741999872:12345-0@lo:502: Request processed in 137us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445753.629934:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789445753.630009:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8457:1876369741999872:0@lo:502: 00000040:00080000:0.0:1789445753.630028:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789445753.630414:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789445753.630435:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789445753.630444:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d472560b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445753.630455:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d472560b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445753.630464:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789445753.630466:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789445753.630469:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789445753.630493:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bea00/0xc1b37c4d472560c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445753.630508:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afeb57bea00/0xc1b37c4d472560c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445753.630517:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afeb57bea00/0xc1b37c4d472560c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445753.630530:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742000000:0@lo:101: 00000100:00100000:2.0:1789445753.630561:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445753.632003:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb5485180 going to sleep for 11 seconds 00000100:00100000:1.0:1789445753.632189:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742000000 00000100:00100000:1.0:1789445753.632198:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742000000 00000100:00100000:1.0:1789445753.632240:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789445753.632260:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+13:5838:x1876369742000000:12345-0@lo:101: 00010000:00010000:1.0:1789445753.632271:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445753.632285:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81679400/0xc1b37c4d472560c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472560c2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.632310:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81679400/0xc1b37c4d472560c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472560c2 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.632321:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81679400/0xc1b37c4d472560c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472560c2 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.632329:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81679400, rc 0) 00000100:00100000:1.0:1789445753.632424:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:5838:x1876369742000000:12345-0@lo:101: Request processed in 176us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445753.632431:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789445753.632596:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742000000:0@lo:101: 00010000:00010000:2.0:1789445753.632611:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afeb57bea00/0xc1b37c4d472560c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445753.632620:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afeb57bea00/0xc1b37c4d472560c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472560c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445753.632801:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742000128:0@lo:501: 00000100:00100000:2.0:1789445753.632833:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445753.632861:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb5485180 going to sleep for 11 seconds 00000100:00100000:0.0:1789445753.632895:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742000128 00000100:00100000:0.0:1789445753.632900:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742000128 00000100:00100000:0.0:1789445753.632931:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789445753.632950:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:5838:x1876369742000128:12345-0@lo:501: 00000100:00100000:0.0:1789445753.633881:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:5838:x1876369742000128:12345-0@lo:501: Request processed in 929us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445753.633891:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789445753.634223:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742000128:0@lo:501: 00000100:00100000:2.0:1789445753.634328:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742000256:0@lo:503: 00000100:00100000:2.0:1789445753.634378:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445753.634449:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb5485180 going to sleep for 11 seconds 00000100:00100000:3.0:1789445753.634482:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742000256 00000100:00100000:3.0:1789445753.634488:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742000256 00000100:00100000:3.0:1789445753.634555:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789445753.634564:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:5838:x1876369742000256:12345-0@lo:503: 00000100:00100000:3.0:1789445753.634811:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:5838:x1876369742000256:12345-0@lo:503: Request processed in 248us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445753.634817:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789445753.634897:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742000256:0@lo:503: 00000100:00100000:2.0:1789445753.635578:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8458:1876369742000384:0@lo:502: 00000100:00100000:2.0:1789445753.635627:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445753.638927:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb5485c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789445753.642571:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742000384 00000100:00100000:0.0:1789445753.642585:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742000384 00000100:00100000:0.0:1789445753.643554:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789445753.643564:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:8458:x1876369742000384:12345-0@lo:502: 00000100:00100000:0.0:1789445753.644113:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:8458:x1876369742000384:12345-0@lo:502: Request processed in 548us (8483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445753.644123:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789445753.644359:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8458:1876369742000384:0@lo:502: 00000020:01000000:2.0:1789445753.644402:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789445753.644411:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445753.644414:0:8458:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789445753.644420:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789445753.644452:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8458:1876369742000512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789445753.644493:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445753.644527:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d5b6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789445753.644964:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742000512 00000100:00100000:0.0:1789445753.644981:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742000512 00000100:00100000:0.0:1789445753.645019:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789445753.645025:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:8458:x1876369742000512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789445753.645218:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:8458:x1876369742000512:12345-0@lo:502:llog_process_th.0 Request processed in 192us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445753.645225:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789445753.645479:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8458:1876369742000512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789445753.645504:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789445753.645509:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445753.645511:0:8458:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789445753.645515:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789445753.646167:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789445753.646186:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789445753.646195:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bea00/0xc1b37c4d472560c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445753.646216:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afeb57bea00/0xc1b37c4d472560c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445753.646227:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789445753.646237:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afe8533d800 from 39 10000000:01000000:0.0:1789445753.646240:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789445753.646377:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445753.646386:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445753.646394:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445753.646412:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742000640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789445753.646453:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445753.646489:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf9fb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445753.646538:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742000640 00000100:00100000:1.0:1789445753.646544:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742000640 00000100:00100000:1.0:1789445753.646584:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789445753.646592:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:5838:x1876369742000640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789445753.646601:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445753.646613:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81679200/0xc1b37c4d472560d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472560d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.646646:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81679200/0xc1b37c4d472560d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472560d0 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.646664:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81679200/0xc1b37c4d472560d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472560d0 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.646681:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81679200, rc 0) 00000100:00100000:1.0:1789445753.646721:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369742000640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445753.646727:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789445753.646936:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742000640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789445753.646948:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445753.646956:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472560d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445753.647023:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742000768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789445753.647085:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445753.647101:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf9fb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445753.647267:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742000768 00000100:00100000:1.0:1789445753.647272:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742000768 00000100:00100000:1.0:1789445753.647301:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789445753.647309:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369742000768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789445753.647546:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369742000768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445753.647553:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789445753.647789:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742000768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789445753.647822:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf761500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742000896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789445753.647859:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445753.647882:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91474300 going to sleep for 11 seconds 00000100:00100000:1.0:1789445753.648137:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742000896 00000100:00100000:1.0:1789445753.648142:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742000896 00000100:00100000:1.0:1789445753.648205:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789445753.648213:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369742000896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789445753.648373:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369742000896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445753.648379:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789445753.648435:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf761500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742000896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789445753.648597:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8459:1876369742001024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789445753.648630:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445753.654567:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d5b69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445753.655960:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742001024 00000100:00100000:3.0:1789445753.655973:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742001024 00000100:00100000:2.0:1789445753.658299:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789445753.658313:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:8459:x1876369742001024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789445753.659412:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:8459:x1876369742001024:12345-0@lo:502:llog_process_th.0 Request processed in 1097us (10776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445753.659422:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789445753.659505:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8459:1876369742001024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789445753.659570:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8459:1876369742001152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789445753.659791:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445753.659874:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf9fb840 going to sleep for 11 seconds 00000100:00100000:1.0:1789445753.659909:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742001152 00000100:00100000:1.0:1789445753.659917:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742001152 00000100:00100000:1.0:1789445753.660008:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789445753.660016:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:8459:x1876369742001152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789445753.660219:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:8459:x1876369742001152:12345-0@lo:502:llog_process_th.0 Request processed in 204us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445753.660226:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789445753.660303:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8459:1876369742001152:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789445753.660323:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789445753.660489:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789445753.660505:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789445753.660520:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445753.660530:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445753.660539:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789445753.660542:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789445753.660545:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789445753.660567:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472560de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445753.660576:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472560de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445753.660585:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472560de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445753.660606:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742001280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789445753.660632:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445753.660966:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d5b6300 going to sleep for 11 seconds 00000100:00100000:3.0:1789445753.661001:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742001280 00000100:00100000:3.0:1789445753.661007:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742001280 00000100:00100000:1.0:1789445753.661069:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789445753.661078:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:5838:x1876369742001280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789445753.661088:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445753.661101:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81678c00/0xc1b37c4d472560e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472560de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.661123:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81678c00/0xc1b37c4d472560e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472560de expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.661132:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81678c00/0xc1b37c4d472560e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472560de expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.661140:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81678c00, rc 0) 00000100:00100000:1.0:1789445753.661174:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369742001280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445753.661179:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789445753.661304:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742001280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789445753.661317:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472560de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445753.661325:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472560de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472560e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445753.661368:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742001408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789445753.661401:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445753.661425:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d5b6300 going to sleep for 11 seconds 00000100:00100000:0.0:1789445753.661465:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742001408 00000100:00100000:0.0:1789445753.661469:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742001408 00000100:00100000:0.0:1789445753.661488:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789445753.661494:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369742001408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789445753.661744:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369742001408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445753.661752:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789445753.661877:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742001408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789445753.661903:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742001536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789445753.661939:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445753.661961:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d5b6300 going to sleep for 11 seconds 00000100:00100000:0.0:1789445753.662548:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742001536 00000100:00100000:0.0:1789445753.662554:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742001536 00000100:00100000:0.0:1789445753.662580:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789445753.662588:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369742001536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789445753.662904:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369742001536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 315us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445753.662911:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789445753.663001:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742001536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789445753.663415:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8460:1876369742001664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789445753.663450:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445753.663480:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d5b6840 going to sleep for 11 seconds 00000100:00100000:0.0:1789445753.663515:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742001664 00000100:00100000:0.0:1789445753.663519:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742001664 00000100:00100000:0.0:1789445753.663537:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789445753.663542:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:8460:x1876369742001664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789445753.664157:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:8460:x1876369742001664:12345-0@lo:502:llog_process_th.0 Request processed in 612us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445753.664166:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789445753.664786:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8460:1876369742001664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789445753.664819:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789445753.664828:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445753.664831:0:8460:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789445753.664837:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789445753.664867:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8460:1876369742001792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789445753.664909:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445753.667222:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d5b6840 going to sleep for 11 seconds 00000100:00100000:3.0:1789445753.667947:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742001792 00000100:00100000:3.0:1789445753.667957:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742001792 00000100:00100000:3.0:1789445753.668075:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789445753.668084:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:8460:x1876369742001792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789445753.668340:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:8460:x1876369742001792:12345-0@lo:502:llog_process_th.0 Request processed in 257us (3431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445753.668355:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789445753.668450:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8460:1876369742001792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789445753.668483:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789445753.668490:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445753.668492:0:8460:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789445753.668498:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1789445753.669025:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789445753.669077:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789445753.669087:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472560de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.669099:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472560de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445753.669109:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789445753.669112:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afe9d560800 from 39 10000000:01000000:1.0:1789445753.669115:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789445753.669147:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.669168:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.669179:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445753.669201:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742001920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789445753.669243:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445753.670592:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb53e2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789445753.672167:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742001920 00000100:00100000:0.0:1789445753.672180:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742001920 00000100:00100000:0.0:1789445753.672250:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789445753.672274:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369742001920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789445753.672291:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445753.672308:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe8e989c00/0xc1b37c4d472560f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472560ec expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445753.672336:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe8e989c00/0xc1b37c4d472560f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472560ec expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445753.672349:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe8e989c00/0xc1b37c4d472560f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472560ec expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445753.672356:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989c00, rc 0) 00000100:00100000:0.0:1789445753.672420:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742001920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (3176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445753.672426:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789445753.672529:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742001920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789445753.672546:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.672556:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472560f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445753.672621:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742002048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789445753.673453:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445753.673529:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb53e2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789445753.674454:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742002048 00000100:00100000:0.0:1789445753.674465:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742002048 00000100:00100000:0.0:1789445753.674504:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789445753.674513:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742002048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789445753.675015:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742002048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 501us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445753.675023:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789445753.675153:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742002048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789445753.675200:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742002176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789445753.675242:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445753.675281:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb53e2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789445753.675325:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742002176 00000100:00100000:0.0:1789445753.675329:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742002176 00000100:00100000:0.0:1789445753.675347:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789445753.675354:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742002176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789445753.675493:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742002176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445753.675509:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789445753.679165:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742002176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789445753.680508:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8461:1876369742002304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789445753.680879:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445753.680927:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe90c51240 going to sleep for 11 seconds 00000100:00100000:1.0:1789445753.681865:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742002304 00000100:00100000:1.0:1789445753.681886:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742002304 00000100:00100000:1.0:1789445753.681943:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789445753.681952:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:8461:x1876369742002304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789445753.682249:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:8461:x1876369742002304:12345-0@lo:502:llog_process_th.0 Request processed in 297us (1657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445753.682257:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789445753.682512:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8461:1876369742002304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789445753.682569:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8461:1876369742002432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789445753.682609:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445753.682632:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4ebe600 going to sleep for 11 seconds 00000100:00100000:1.0:1789445753.683120:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742002432 00000100:00100000:1.0:1789445753.683127:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742002432 00000100:00100000:1.0:1789445753.683167:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789445753.683175:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:8461:x1876369742002432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789445753.683356:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:8461:x1876369742002432:12345-0@lo:502:llog_process_th.0 Request processed in 181us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445753.683536:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8461:1876369742002432:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789445753.683562:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:1.0:1789445753.684350:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000020:01000000:1.0:1789445753.684528:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789445753.684546:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789445753.684555:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.684566:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445753.684575:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789445753.684577:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1789445753.684580:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789445753.684919:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.684929:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.684948:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445753.684968:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742002560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789445753.685031:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445753.685263:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb53e2300 going to sleep for 11 seconds 00000100:00100000:2.0:1789445753.685655:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742002560 00000100:00100000:2.0:1789445753.685664:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742002560 00000100:00100000:2.0:1789445753.686399:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789445753.686412:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742002560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789445753.686427:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445753.686444:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afeb57bf800/0xc1b37c4d47256101 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472560fa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445753.686468:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afeb57bf800/0xc1b37c4d47256101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472560fa expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445753.686491:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afeb57bf800/0xc1b37c4d47256101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472560fa expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445753.686499:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf800, rc 0) 00000100:00100000:2.0:1789445753.686560:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742002560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445753.686566:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789445753.688625:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742002560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789445753.688744:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256101 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445753.688758:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47256101 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445753.688906:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf760000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742002688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789445753.688958:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445753.689199:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91474480 going to sleep for 11 seconds 00000100:00100000:1.0:1789445753.689469:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742002688 00000100:00100000:1.0:1789445753.689476:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742002688 00000100:00100000:1.0:1789445753.689555:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789445753.689564:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742002688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789445753.689848:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742002688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445753.689855:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789445753.689921:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf760000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742002688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789445753.689955:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742002816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789445753.690012:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445753.690826:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d5b6840 going to sleep for 11 seconds 00000100:00100000:0.0:1789445753.690943:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742002816 00000100:00100000:0.0:1789445753.690948:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742002816 00000100:00100000:0.0:1789445753.690978:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789445753.690985:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742002816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789445753.691192:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742002816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445753.691199:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789445753.691337:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742002816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789445753.691979:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8462:1876369742002944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789445753.692038:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445753.692096:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb53e2900 going to sleep for 11 seconds 00000100:00100000:0.0:1789445753.692202:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742002944 00000100:00100000:0.0:1789445753.692211:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742002944 00000100:00100000:0.0:1789445753.692320:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789445753.692328:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:8462:x1876369742002944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789445753.692592:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:8462:x1876369742002944:12345-0@lo:502:llog_process_th.0 Request processed in 265us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445753.692599:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789445753.692687:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8462:1876369742002944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789445753.692711:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789445753.692719:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445753.692721:0:8462:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789445753.692726:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789445753.692752:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8462:1876369742003072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789445753.692784:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445753.693027:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb53e2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789445753.693068:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742003072 00000100:00100000:3.0:1789445753.693073:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742003072 00000100:00100000:3.0:1789445753.693096:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789445753.693102:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:8462:x1876369742003072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789445753.694893:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:8462:x1876369742003072:12345-0@lo:502:llog_process_th.0 Request processed in 1783us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445753.694905:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789445753.695090:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8462:1876369742003072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789445753.695143:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445753.695150:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445753.695152:0:8462:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789445753.695156:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789445753.699532:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1789445753.699565:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789445753.699578:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256101 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445753.699612:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256101 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445753.699622:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789445753.699625:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9afea4f94d40 from 1 10000000:01000000:2.0:1789445753.699628:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789445753.700262:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47256108 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445753.700272:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47256108 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445753.700283:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47256108 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445753.700306:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742003200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789445753.700370:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445753.700446:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d5b6840 going to sleep for 11 seconds 00000100:00100000:1.0:1789445753.700604:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742003200 00000100:00100000:1.0:1789445753.700613:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742003200 00000100:00100000:1.0:1789445753.701005:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789445753.701016:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742003200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789445753.701029:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445753.701042:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81678000/0xc1b37c4d4725610f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47256108 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.701083:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81678000/0xc1b37c4d4725610f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47256108 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.701093:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81678000/0xc1b37c4d4725610f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47256108 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445753.701101:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81678000, rc 0) 00000100:00100000:1.0:1789445753.701149:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742003200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445753.701155:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789445753.701229:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742003200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789445753.701243:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47256108 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725610f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445753.701253:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47256108 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d4725610f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445753.701305:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742003328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789445753.701331:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445753.701610:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d5b6840 going to sleep for 11 seconds 00000100:00100000:0.0:1789445753.703195:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742003328 00000100:00100000:0.0:1789445753.703208:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742003328 00000100:00100000:0.0:1789445753.703260:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789445753.703269:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742003328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789445753.703606:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742003328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 337us (2273us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789445753.703614:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789445753.704493:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742003328:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789445753.704530:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789445753.704539:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47256108 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725610f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445753.704550:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47256108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725610f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445753.890251:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445753.890302:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445753.890338:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445753.890369:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445753.890476:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722052992 00000100:00100000:0.0:1789445753.890488:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722052992 00000100:00100000:0.0:1789445753.890549:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 163 00000100:00100000:0.0:1789445753.890562:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+8:2377:x1876369722052992:12345-192.168.206.59@tcp:400: 00000100:00100000:0.0:1789445753.890648:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+8:2377:x1876369722052992:12345-192.168.206.59@tcp:400: Request processed in 89us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445753.890656:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 163 00000100:00100000:2.0:1789445753.890864:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722053120 00000100:00100000:2.0:1789445753.890878:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722053120 00000100:00100000:3.0:1789445753.890904:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722053248 00000100:00100000:3.0:1789445753.890912:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722053248 00000100:00100000:2.0:1789445753.890981:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 26 00000100:00100000:3.0:1789445753.890983:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722053376 00000100:00100000:3.0:1789445753.890989:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722053376 00000100:00100000:2.0:1789445753.891009:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2376:x1876369722053120:12345-192.168.206.59@tcp:400: 00000100:00100000:3.0:1789445753.891026:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:3.0:1789445753.891036:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2377:x1876369722053248:12345-192.168.206.59@tcp:400: 00000100:00100000:2.0:1789445753.891116:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2376:x1876369722053120:12345-192.168.206.59@tcp:400: Request processed in 122us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445753.891128:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2377:x1876369722053248:12345-192.168.206.59@tcp:400: Request processed in 90us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445753.891129:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 26 00000100:00100000:3.0:1789445753.891148:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:2.0:1789445753.891207:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00100000:2.0:1789445753.891219:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2376:x1876369722053376:12345-192.168.206.59@tcp:400: 00000100:00080000:0.0:1789445753.891244:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789445753.891250:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789445753.891253:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445753.891299:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2376:x1876369722053376:12345-192.168.206.59@tcp:400: Request processed in 82us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445753.896588:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00100000:0.0:1789445753.947094:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742003456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789445753.947200:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445753.947339:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742003456 00000100:00100000:3.0:1789445753.947350:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742003456 00000100:00100000:3.0:1789445753.947449:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789445753.947460:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742003456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789445753.947506:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789445753.947719:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445753.960033:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742003456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12561us (12819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445753.960073:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789445753.965189:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb5758a80 x1876369742003456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445753.965225:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742003456:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789445754.586780:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445755.611727:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445755.994486:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876369742003712:0@lo:400:kworker.0 00000100:00100000:2.0:1789445755.994596:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445755.994688:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742004224:0@lo:400:kworker.0 00000100:00100000:2.0:1789445755.994718:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445755.994791:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789445755.994799:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742003584:0@lo:400:kworker.0 00000100:00100000:2.0:1789445755.994833:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445755.994854:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742004096:0@lo:400:kworker.0 00000100:00100000:2.0:1789445755.994877:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445755.994920:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742003712 00000100:00100000:2.0:1789445755.994929:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742003712 00000100:00100000:2.0:1789445755.994998:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742004096 00000100:00100000:2.0:1789445755.995001:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742004096 00000100:00100000:2.0:1789445755.995036:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789445755.995080:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876369742003712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445755.995138:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876369742003712:12345-0@lo:400:kworker.0 Request processed in 92us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445755.995145:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789445755.995164:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789445755.995171:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369742004096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445755.995196:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369742004096:12345-0@lo:400:kworker.0 Request processed in 26us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445755.995202:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789445755.995223:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445755.995239:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742003840:0@lo:400:kworker.0 00000100:00100000:2.0:1789445755.995263:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445755.995281:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789445755.995287:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742003968:0@lo:400:kworker.0 00000100:00100000:2.0:1789445755.995328:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445755.995354:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742003840 00000100:00100000:2.0:1789445755.995357:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742003840 00000100:00100000:2.0:1789445755.995391:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789445755.995397:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742003840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445755.995430:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742003840:12345-0@lo:400:kworker.0 Request processed in 34us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445755.995436:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789445755.995450:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445755.995484:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742003840:0@lo:400:kworker.0 00000100:00100000:2.0:1789445755.995513:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742004096:0@lo:400:kworker.0 00000100:00100000:2.0:1789445755.995522:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876369742003712:0@lo:400:kworker.0 00000100:00100000:3.0:1789445755.995922:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742004224 00000100:00100000:3.0:1789445755.995928:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742004224 00000100:00100000:3.0:1789445755.995979:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742003968 00000100:00100000:3.0:1789445755.995992:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742003968 00000100:00100000:3.0:1789445755.996013:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789445755.996020:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742004224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445755.996096:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742004224:12345-0@lo:400:kworker.0 Request processed in 78us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445755.996103:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789445755.996115:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789445755.996120:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742003968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445755.996149:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742003968:12345-0@lo:400:kworker.0 Request processed in 29us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445755.996154:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789445755.996185:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb5759f80 x1876369742003968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445755.996197:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742003968:0@lo:400:kworker.0 00010000:00080000:3.0:1789445755.996221:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb5759880 x1876369742004224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445755.996241:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742004224:0@lo:400:kworker.0 00000100:00100000:3.0:1789445755.996261:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742003584 00000100:00100000:3.0:1789445755.996265:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742003584 00000100:00100000:3.0:1789445755.996290:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789445755.996296:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742003584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445755.996333:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742003584:12345-0@lo:400:kworker.0 Request processed in 37us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445755.996339:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789445755.996364:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742003584:0@lo:400:kworker.0 00000100:00080000:2.0:1789445755.997108:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789445755.997116:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789445756.065441:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445756.065616:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722053504 00000100:00100000:1.0:1789445756.065638:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722053504 00000100:00100000:1.0:1789445756.065710:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 165 00000100:00100000:1.0:1789445756.065742:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+8:5631:x1876369722053504:12345-192.168.206.59@tcp:101: 00010000:00010000:1.0:1789445756.065768:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445756.065805:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81678800/0xc1b37c4d47256116 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4a5e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445756.065841:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81678800/0xc1b37c4d47256116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a5e expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445756.065853:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81678800/0xc1b37c4d47256116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a5e expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445756.065863:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81678800, rc 0) 00000100:00100000:1.0:1789445756.065944:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:5631:x1876369722053504:12345-192.168.206.59@tcp:101: Request processed in 205us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445756.065955:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 165 00000100:00100000:1.0:1789445756.073011:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445756.073225:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722053632 00000100:00100000:0.0:1789445756.073238:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722053632 00000100:00100000:0.0:1789445756.073302:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 166 00000100:00100000:0.0:1789445756.073335:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:5631:x1876369722053632:12345-192.168.206.59@tcp:501: 00000100:00100000:0.0:1789445756.073706:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:5631:x1876369722053632:12345-192.168.206.59@tcp:501: Request processed in 372us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445756.073715:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 166 00000100:00100000:2.0:1789445756.075925:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445756.076319:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722053760 00000100:00100000:3.0:1789445756.076340:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722053760 00000100:00100000:3.0:1789445756.076406:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 167 00000100:00100000:3.0:1789445756.076418:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:5631:x1876369722053760:12345-192.168.206.59@tcp:503: 00000100:00100000:3.0:1789445756.079370:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:5631:x1876369722053760:12345-192.168.206.59@tcp:503: Request processed in 2934us (3439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445756.079389:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 167 00000100:00100000:3.0:1789445756.085742:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445756.085936:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722053888 00000100:00100000:1.0:1789445756.085950:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722053888 00000100:00100000:1.0:1789445756.086193:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 168 00000100:00100000:1.0:1789445756.086207:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:6115:x1876369722053888:12345-192.168.206.59@tcp:502: 00000100:00100000:1.0:1789445756.086616:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:6115:x1876369722053888:12345-192.168.206.59@tcp:502: Request processed in 410us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445756.086874:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 168 00000100:00100000:1.0:1789445756.095031:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445756.095164:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722054016 00000100:00100000:0.0:1789445756.095178:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722054016 00000100:00100000:0.0:1789445756.095246:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 169 00000100:00100000:0.0:1789445756.095259:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:6115:x1876369722054016:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789445756.095625:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:6115:x1876369722054016:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 367us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445756.095633:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 169 00000100:00100000:3.0:1789445756.104568:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445756.104892:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722054144 00000100:00100000:1.0:1789445756.104910:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722054144 00000100:00100000:1.0:1789445756.104992:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 170 00000100:00100000:1.0:1789445756.105004:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:5631:x1876369722054144:12345-192.168.206.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789445756.105087:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445756.105112:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81678600/0xc1b37c4d4725611d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4a65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445756.105154:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81678600/0xc1b37c4d4725611d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a65 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445756.105167:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81678600/0xc1b37c4d4725611d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a65 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445756.105178:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81678600, rc 0) 00000100:00100000:1.0:1789445756.105249:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:5631:x1876369722054144:12345-192.168.206.59@tcp:101:ll_cfg_requeue.0 Request processed in 248us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445756.105257:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 170 00000100:00100000:3.0:1789445756.108694:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445756.110211:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722054272 00000100:00100000:2.0:1789445756.110235:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722054272 00000100:00100000:2.0:1789445756.110314:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 171 00000100:00100000:2.0:1789445756.111609:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:5631:x1876369722054272:12345-192.168.206.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789445756.114144:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:5631:x1876369722054272:12345-192.168.206.59@tcp:501:ll_cfg_requeue.0 Request processed in 2823us (5450us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789445756.114164:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 171 00000100:00100000:0.0:1789445756.506576:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789445756.506608:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742004352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789445756.506710:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445756.506875:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742004352 00000100:00100000:1.0:1789445756.506890:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742004352 00000100:00100000:1.0:1789445756.506962:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789445756.506973:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742004352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789445756.507027:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445756.507121:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742004352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445756.507129:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789445756.507286:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf760e00 x1876369742004352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445756.507308:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742004352:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789445756.638541:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789445757.627572:0:8500:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff19b6170 20000000:00000080:0.0:1789445757.627589:0:8500:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9afeba6b8000 uarg=0000000000000000 20000000:01000000:0.0:1789445757.627794:0:8500:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789445757.629890:0:8500:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789445757.629898:0:8500:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789445757.630709:0:8501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789445757.630857:0:8500:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789445757.642206:0:8500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789445757.642272:0:8500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789445757.642339:0:8500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789445757.642362:0:8500:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789445757.642726:0:8500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afe81678a00/0xc1b37c4d47256124 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445757.642762:0:8500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe81678400/0xc1b37c4d47255e99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255e92 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445757.642769:0:8500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe8e989200/0xc1b37c4d47255efb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255ef4 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445757.642776:0:8500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe81505c00/0xc1b37c4d47255fc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47255fbf expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445757.642950:0:8500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe81679000/0xc1b37c4d47256083 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a2d expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445757.642960:0:8500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afe81678a00/0xc1b37c4d47256124 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445757.643022:0:8500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe81679000/0xc1b37c4d47256083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a2d expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445757.643040:0:8500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afe81679000/0xc1b37c4d47256083 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a2d expref: 9 pid: 5834 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445757.643096:0:8500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5758700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1876369742004480:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789445757.643436:0:8500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe81505c00/0xc1b37c4d47255fc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255fbf expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445757.643447:0:8500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe81505c00/0xc1b37c4d47255fc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255fbf expref: 18 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445757.643469:0:8500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5759880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1876369742004608:0@lo:104: 00000100:00100000:1.0:1789445757.643552:0:8500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789445757.643605:0:8500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe8e989200/0xc1b37c4d47255efb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255ef4 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445757.643614:0:8500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe8e989200/0xc1b37c4d47255efb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255ef4 expref: 18 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445757.643625:0:8500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5758380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1876369742004736:0@lo:104: 00000100:00100000:3.0:1789445757.643640:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742004608 00000100:00100000:1.0:1789445757.643656:0:8500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445757.643657:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742004608 00010000:00010000:1.0:1789445757.643699:0:8500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe81678400/0xc1b37c4d47255e99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47255e92 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445757.643711:0:8500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe81678400/0xc1b37c4d47255e99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47255e92 expref: 18 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445757.643722:0:8500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1876369742004864:0@lo:104: 00000100:00100000:1.0:1789445757.643747:0:8500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91ad8840 going to sleep for 11 seconds 00000100:00100000:3.0:1789445757.643756:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789445757.643800:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445757.643849:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742004736 00000100:00100000:3.0:1789445757.643853:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742004736 00000100:00100000:3.0:1789445757.643870:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742004864 00000100:00100000:3.0:1789445757.643872:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742004864 00000100:00100000:3.0:1789445757.643884:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789445757.643892:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5759f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:8500:x1876369742004608:12345-0@lo:104: 00010000:00010000:3.0:1789445757.643909:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255fbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255fc6 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.643999:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789445757.644005:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5759f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:8500:x1876369742004608:12345-0@lo:104: Request processed in 114us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445757.644012:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789445757.644034:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789445757.644042:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5b03850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+4:8500:x1876369742004736:12345-0@lo:104: 00010000:00010000:3.0:1789445757.644081:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe81504e00/0xc1b37c4d47255ef4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255efb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.644128:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789445757.644135:0:8500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5759880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1876369742004608:0@lo:104: 00000100:00100000:3.0:1789445757.644140:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5b03850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+4:8500:x1876369742004736:12345-0@lo:104: Request processed in 98us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445757.644151:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789445757.644160:0:8500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5758380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1876369742004736:0@lo:104: 00000100:00100000:3.0:1789445757.644204:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789445757.644212:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:8500:x1876369742004864:12345-0@lo:104: 00010000:00010000:3.0:1789445757.644219:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe8e989600/0xc1b37c4d47255e92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255e99 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.644266:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789445757.644277:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:8500:x1876369742004864:12345-0@lo:104: Request processed in 66us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445757.644283:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789445757.644309:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789445757.644315:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255fbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255fc6 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.644325:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81504a00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:3.0:1789445757.644329:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255fbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255fc6 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445757.644334:0:8500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1876369742004864:0@lo:104: 00010000:00010000:3.0:1789445757.644350:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255fbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255fc6 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789445757.644358:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255fbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255fc6 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789445757.644377:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789445757.644412:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255fbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255fc6 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.644419:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789445757.644449:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255fbf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255fc6 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.644457:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81504a00/0xc1b37c4d47255fbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255fc6 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445757.644464:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789445757.644473:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789445757.644478:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81504e00/0xc1b37c4d47255ef4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255efb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445757.644485:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742004992:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789445757.644501:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81504e00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:3.0:1789445757.644505:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81504e00/0xc1b37c4d47255ef4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255efb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.644512:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81504e00/0xc1b37c4d47255ef4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255efb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789445757.644518:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81504e00/0xc1b37c4d47255ef4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255efb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789445757.644523:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789445757.644545:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe81504e00/0xc1b37c4d47255ef4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255efb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.644551:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789445757.644564:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81504e00/0xc1b37c4d47255ef4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255efb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.644569:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81504e00/0xc1b37c4d47255ef4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255efb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.644577:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789445757.644580:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe8e989600/0xc1b37c4d47255e92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47255e99 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.644585:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989600 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:3.0:1789445757.644588:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e989600/0xc1b37c4d47255e92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47255e99 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.644603:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe8e989600/0xc1b37c4d47255e92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47255e99 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789445757.644609:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e989600/0xc1b37c4d47255e92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47255e99 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789445757.644614:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789445757.644625:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe8e989600/0xc1b37c4d47255e92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255e99 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.644630:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789445757.644635:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe8e989600/0xc1b37c4d47255e92 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255e99 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.644641:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe8e989600/0xc1b37c4d47255e92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47255e99 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.644654:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445757.644655:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445757.644657:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445757.644663:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445757.644668:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445757.644677:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445757.644687:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369742005120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789445757.644735:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445757.644920:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742004992 00000100:00100000:1.0:1789445757.644929:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742004992 00010000:00010000:1.0:1789445757.644964:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe81505c00/0xc1b37c4d47255fc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255fbf expref: 19 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445757.645005:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742005120 00000100:00100000:1.0:1789445757.645020:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742005120 00010000:00010000:1.0:1789445757.645034:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe8e989200/0xc1b37c4d47255efb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255ef4 expref: 20 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445757.645081:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789445757.645089:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+20:3312:x1876369742004992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789445757.645117:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445757.645124:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe81505c00/0xc1b37c4d47255fc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255fbf expref: 20 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445757.645134:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe81505c00/0xc1b37c4d47255fc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255fbf expref: 20 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445757.645152:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81505c00/0xc1b37c4d47255fc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255fbf expref: 20 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445757.645182:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445757.645184:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789445757.645198:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf763b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3310:x1876369742005120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789445757.645222:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445757.645229:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe8e989200/0xc1b37c4d47255efb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255ef4 expref: 19 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445757.645239:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3312:x1876369742004992:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (701us total) trans 0 rc 0/0 00010000:00010000:0.0:1789445757.645249:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe8e989200/0xc1b37c4d47255efb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255ef4 expref: 19 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445757.645256:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789445757.645281:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe8e989200/0xc1b37c4d47255efb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255ef4 expref: 18 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445757.645298:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445757.645321:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742004992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789445757.645355:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf763b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:3310:x1876369742005120:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445757.645377:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789445757.645527:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369742005120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789445757.645544:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789445757.645550:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369742005248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789445757.645574:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445757.645683:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742005248 00000100:00100000:3.0:1789445757.645689:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742005248 00010000:00010000:3.0:1789445757.645707:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe81678400/0xc1b37c4d47255e99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255e92 expref: 17 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445757.645773:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789445757.645781:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:3310:x1876369742005248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789445757.645789:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445757.645792:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe81678400/0xc1b37c4d47255e99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47255e92 expref: 17 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.645800:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe81678400/0xc1b37c4d47255e99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47255e92 expref: 17 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.645809:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81678400/0xc1b37c4d47255e99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47255e92 expref: 17 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445757.645817:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445757.645966:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:3310:x1876369742005248:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445757.645984:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789445757.648135:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369742005248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789445757.658620:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445757.662738:0:8500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5758700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1876369742004480:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789445757.662792:0:8500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afe81678a00/0xc1b37c4d47256124 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445757.664213:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445757.664495:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722054400 00000100:00100000:0.0:1789445757.664512:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722054400 00010000:00010000:0.0:1789445757.664557:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe81679000/0xc1b37c4d47256083 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a2d expref: 10 pid: 5834 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445757.664612:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 24 00000100:00100000:0.0:1789445757.664622:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf762680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2375:x1876369722054400:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789445757.664636:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445757.664642:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe81679000/0xc1b37c4d47256083 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a2d expref: 10 pid: 5834 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445757.664657:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe81679000/0xc1b37c4d47256083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a2d expref: 10 pid: 5834 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445757.664678:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81679000/0xc1b37c4d47256083 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a2d expref: 10 pid: 5834 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445757.664710:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afe81678a00/0xc1b37c4d47256124 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445757.664719:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81678a00/0xc1b37c4d47256124 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445757.664738:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afe81678a00/0xc1b37c4d47256124 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445757.664745:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afe81678a00/0xc1b37c4d47256124 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445757.664754:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afe81678a00/0xc1b37c4d47256124 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445757.664762:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afe81678a00/0xc1b37c4d47256124 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445757.664769:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81678a00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445757.664774:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afe81678a00/0xc1b37c4d47256124 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445757.664782:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afe81678a00/0xc1b37c4d47256124 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445757.664804:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afe81678a00/0xc1b37c4d47256124 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445757.664816:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789445757.664858:0:8500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afe81678a00/0xc1b37c4d47256124 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445757.664873:0:8500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afe81678a00/0xc1b37c4d47256124 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445757.664894:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf762680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:2375:x1876369722054400:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 271us (691us total) trans 0 rc 0/0 00010000:00010000:1.0:1789445757.664907:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81678a00/0xc1b37c4d47256124 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445757.664919:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 24 00000100:00100000:3.0:1789445757.814449:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445757.814527:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722054528 00000100:00100000:1.0:1789445757.814538:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722054528 00000100:00100000:1.0:1789445757.814591:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 172 00000100:00100000:1.0:1789445757.814613:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:5631:x1876369722054528:12345-192.168.206.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789445757.814631:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445757.814651:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81678a00/0xc1b37c4d4725612b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4a6c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445757.814678:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81678a00/0xc1b37c4d4725612b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a6c expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445757.814688:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81678a00/0xc1b37c4d4725612b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a6c expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445757.814697:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81678a00, rc 0) 00000100:00100000:1.0:1789445757.814760:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:5631:x1876369722054528:12345-192.168.206.59@tcp:101:ll_cfg_requeue.0 Request processed in 150us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445757.814767:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 172 00000100:00100000:2.0:1789445757.820310:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445757.820718:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722054656 00000100:00100000:3.0:1789445757.820744:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722054656 00000100:00100000:3.0:1789445757.820802:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 173 00000100:00100000:3.0:1789445757.820813:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:5631:x1876369722054656:12345-192.168.206.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789445757.821762:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:5631:x1876369722054656:12345-192.168.206.59@tcp:501:ll_cfg_requeue.0 Request processed in 947us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445757.821772:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 173 00000100:00100000:3.0:1789445757.827835:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445757.827914:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722054784 00000100:00100000:2.0:1789445757.827924:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722054784 00000100:00100000:2.0:1789445757.827991:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 174 00000100:00100000:2.0:1789445757.828009:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:5631:x1876369722054784:12345-192.168.206.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789445757.828248:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:5631:x1876369722054784:12345-192.168.206.59@tcp:503:ll_cfg_requeue.0 Request processed in 240us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445757.828261:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 174 00000100:00100000:3.0:1789445757.830630:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445757.830852:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722054912 00000100:00100000:2.0:1789445757.830862:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722054912 00000100:00100000:2.0:1789445757.830916:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 175 00000100:00100000:2.0:1789445757.830926:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:6141:x1876369722054912:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789445757.831171:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:6141:x1876369722054912:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 246us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445757.831180:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 175 00000100:00100000:0.0:1789445757.841680:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445757.844996:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722055040 00000100:00100000:3.0:1789445757.845009:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722055040 00000100:00100000:3.0:1789445757.845066:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 176 00000100:00100000:3.0:1789445757.845075:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:6141:x1876369722055040:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789445757.845281:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:6141:x1876369722055040:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 206us (3609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445757.845289:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 176 00010000:00010000:3.0:1789445758.688927:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445759.020254:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445759.020572:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445759.020796:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722055168 00000100:00100000:2.0:1789445759.020816:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722055168 00000100:00100000:2.0:1789445759.020913:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 177 00000100:00100000:2.0:1789445759.020927:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2377:x1876369722055168:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445759.022151:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445759.022185:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445759.022260:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2377:x1876369722055168:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 1328us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445759.022275:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 177 00000100:00100000:2.0:1789445759.022484:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722055296 00000100:00100000:2.0:1789445759.022496:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722055296 00000100:00100000:2.0:1789445759.022579:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 30 00000100:00100000:2.0:1789445759.022588:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2377:x1876369722055296:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445759.022657:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2377:x1876369722055296:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 71us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445759.022663:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 30 00000100:00080000:2.0:1789445759.022702:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789445759.039265:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722055424 00000100:00100000:1.0:1789445759.039290:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722055424 00000100:00100000:3.0:1789445759.042402:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722055552 00000100:00100000:3.0:1789445759.042434:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722055552 00000100:00100000:3.0:1789445759.042556:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 14 00000100:00100000:3.0:1789445759.042567:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2377:x1876369722055552:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445759.042649:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2377:x1876369722055552:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 85us (20463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445759.042657:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 14 00000100:00100000:1.0:1789445759.044286:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 15 00000100:00100000:1.0:1789445759.044303:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2377:x1876369722055424:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445759.044402:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2377:x1876369722055424:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 104us (23831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445759.044430:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 15 00000100:00080000:2.0:1789445759.047093:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789445759.047106:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789445759.066318:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742005376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789445759.066424:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445759.066519:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742005376 00000100:00100000:1.0:1789445759.066532:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742005376 00000100:00100000:1.0:1789445759.066691:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789445759.066704:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742005376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789445759.066751:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445759.066852:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742005376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445759.066861:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789445759.067228:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789445759.067270:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb5758700 x1876369742005376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445759.067295:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742005376:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1789445759.515782:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789445759.515790:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afebb4dd000 from 4 10000000:01000000:0.0:1789445759.515794:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789445759.515846:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d47256132 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445759.515859:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d47256132 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445759.515870:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d47256132 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445759.515894:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba62ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742005504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789445759.515999:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445759.516097:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe85da73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445759.516185:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742005504 00000100:00100000:2.0:1789445759.516196:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742005504 00000100:00100000:2.0:1789445759.516257:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789445759.516267:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369742005504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789445759.516281:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445759.516294:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afeb57bf000/0xc1b37c4d47256139 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47256132 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445759.516318:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afeb57bf000/0xc1b37c4d47256139 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47256132 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445759.516339:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afeb57bf000/0xc1b37c4d47256139 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47256132 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445759.516348:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf000, rc 0) 00000100:00100000:2.0:1789445759.516394:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742005504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445759.516401:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789445759.517995:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba62ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742005504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789445759.518021:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d47256132 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256139 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445759.518033:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d47256132 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47256139 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445759.518128:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742005632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789445759.518180:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445759.518218:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb5485180 going to sleep for 11 seconds 00000100:00100000:2.0:1789445759.518253:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742005632 00000100:00100000:2.0:1789445759.518259:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742005632 00000100:00100000:2.0:1789445759.518300:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789445759.518310:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742005632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789445759.518567:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742005632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445759.518574:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789445759.518613:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742005632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789445759.518642:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742005760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789445759.518684:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445759.518699:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb5485180 going to sleep for 11 seconds 00000100:00100000:2.0:1789445759.518711:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742005760 00000100:00100000:2.0:1789445759.518715:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742005760 00000100:00100000:2.0:1789445759.518739:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789445759.518745:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742005760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789445759.518910:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742005760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445759.518916:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789445759.522335:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742005760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789445759.531836:0:8576:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf763800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8576:1876369742005888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789445759.531923:0:8576:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445759.531985:0:8576:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afead8223c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445759.532007:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742005888 00000100:00100000:2.0:1789445759.532015:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742005888 00000100:00100000:2.0:1789445759.532092:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789445759.532102:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:8576:x1876369742005888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789445759.532302:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:8576:x1876369742005888:12345-0@lo:502:llog_process_th.0 Request processed in 202us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445759.532311:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789445759.532404:0:8576:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf763800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8576:1876369742005888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789445759.532436:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789445759.532444:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445759.532446:0:8576:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789445759.532454:0:8576:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afebb4dd000 00000020:00000080:2.0:1789445759.532456:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789445759.532542:0:8576:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8576:1876369742006016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789445759.532575:0:8576:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445759.532589:0:8576:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afead8223c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445759.535563:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742006016 00000100:00100000:3.0:1789445759.535580:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742006016 00000100:00100000:3.0:1789445759.535645:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789445759.535658:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:8576:x1876369742006016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789445759.536082:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:8576:x1876369742006016:12345-0@lo:502:llog_process_th.0 Request processed in 425us (3504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445759.536093:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789445759.540170:0:8576:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8576:1876369742006016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789445759.540218:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789445759.540228:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445759.540230:0:8576:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789445759.540234:0:8576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789445759.541793:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789445759.541823:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789445759.541833:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d47256132 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256139 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445759.541847:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d47256132 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256139 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445759.541858:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789445759.541861:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afe8533d800 from 4 10000000:01000000:2.0:1789445759.541863:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789445759.541898:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfc00/0xc1b37c4d47256140 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445759.541906:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfc00/0xc1b37c4d47256140 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445759.541917:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfc00/0xc1b37c4d47256140 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445759.541941:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742006144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789445759.542010:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445759.542098:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb4bd8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445759.542549:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742006144 00000100:00100000:3.0:1789445759.542557:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742006144 00000100:00100000:3.0:1789445759.542617:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789445759.542626:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742006144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789445759.542648:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445759.542661:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47256147 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47256140 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445759.542684:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47256147 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47256140 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445759.542694:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47256147 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47256140 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445759.542703:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fc000, rc 0) 00000100:00100000:3.0:1789445759.542742:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742006144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445759.542749:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789445759.545474:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742006144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789445759.545503:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfc00/0xc1b37c4d47256140 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256147 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445759.545527:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfc00/0xc1b37c4d47256140 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47256147 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445759.545607:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742006272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789445759.545660:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445759.545710:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb4bd8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445759.545718:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742006272 00000100:00100000:3.0:1789445759.545726:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742006272 00000100:00100000:3.0:1789445759.545787:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789445759.545796:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742006272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789445759.546102:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742006272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445759.546111:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789445759.546732:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742006272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789445759.546769:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742006400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789445759.546826:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445759.546859:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb4bd8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445759.546890:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742006400 00000100:00100000:3.0:1789445759.546898:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742006400 00000100:00100000:3.0:1789445759.546940:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789445759.546948:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742006400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789445759.547151:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742006400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445759.547172:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789445759.547213:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742006400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789445759.560032:0:8578:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8578:1876369742006528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789445759.560176:0:8578:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445759.560227:0:8578:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb4bd8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789445759.560691:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742006528 00000100:00100000:0.0:1789445759.560710:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742006528 00000100:00100000:0.0:1789445759.560792:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789445759.560805:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:8578:x1876369742006528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789445759.561185:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:8578:x1876369742006528:12345-0@lo:502:llog_process_th.0 Request processed in 383us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445759.561195:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789445759.562074:0:8578:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8578:1876369742006528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789445759.562129:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789445759.562140:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445759.562142:0:8578:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789445759.562151:0:8578:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afe8533d800 00000020:00000080:2.0:1789445759.562155:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789445759.562244:0:8578:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8578:1876369742006656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789445759.562314:0:8578:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445759.562486:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742006656 00000100:00100000:2.0:1789445759.562501:0:8578:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb4bd8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789445759.562560:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742006656 00000100:00100000:3.0:1789445759.562697:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789445759.562709:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:8578:x1876369742006656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789445759.563027:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:8578:x1876369742006656:12345-0@lo:502:llog_process_th.0 Request processed in 320us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445759.563036:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789445759.564421:0:8578:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8578:1876369742006656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789445759.564473:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789445759.564482:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445759.564485:0:8578:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789445759.564492:0:8578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789445759.565896:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789445759.565927:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789445759.565938:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfc00/0xc1b37c4d47256140 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256147 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445759.565951:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfc00/0xc1b37c4d47256140 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256147 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445759.565973:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789445759.565976:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afe9d560800 from 4 10000000:01000000:2.0:1789445759.565980:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789445759.566019:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57be400/0xc1b37c4d4725614e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445759.566030:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afeb57be400/0xc1b37c4d4725614e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445759.566041:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afeb57be400/0xc1b37c4d4725614e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445759.566089:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742006784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789445759.566151:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445759.566204:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb4bd8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789445759.566480:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742006784 00000100:00100000:3.0:1789445759.566562:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742006784 00000100:00100000:3.0:1789445759.566888:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789445759.566898:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742006784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789445759.566910:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445759.566924:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe813fc600/0xc1b37c4d47256155 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d4725614e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445759.566950:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe813fc600/0xc1b37c4d47256155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d4725614e expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445759.566962:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe813fc600/0xc1b37c4d47256155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d4725614e expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445759.566983:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fc600, rc 0) 00000100:00100000:3.0:1789445759.567037:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742006784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445759.567067:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789445759.569817:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742006784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789445759.569859:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afeb57be400/0xc1b37c4d4725614e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256155 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445759.569898:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afeb57be400/0xc1b37c4d4725614e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47256155 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445759.570022:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba629880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742006912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789445759.570138:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445759.570206:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe85da7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789445759.570710:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742006912 00000100:00100000:3.0:1789445759.570728:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742006912 00000100:00100000:3.0:1789445759.570807:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789445759.570817:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742006912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789445759.571222:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742006912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 405us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445759.571232:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789445759.572572:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba629880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742006912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789445759.572647:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba629880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742007040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789445759.572720:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445759.572780:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe85da7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789445759.574285:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742007040 00000100:00100000:2.0:1789445759.574301:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742007040 00000100:00100000:2.0:1789445759.574371:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789445759.574381:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742007040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789445759.575270:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742007040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 886us (2544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445759.575281:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789445759.575318:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba629880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742007040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789445759.582639:0:8583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8583:1876369742007168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789445759.582761:0:8583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445759.582828:0:8583:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d5b6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789445759.582851:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742007168 00000100:00100000:1.0:1789445759.582867:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742007168 00000100:00100000:1.0:1789445759.582938:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789445759.582948:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:8583:x1876369742007168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789445759.583279:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:8583:x1876369742007168:12345-0@lo:502:llog_process_th.0 Request processed in 331us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445759.583286:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789445759.583430:0:8583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8583:1876369742007168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789445759.583472:0:8583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789445759.583484:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445759.583486:0:8583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789445759.583497:0:8583:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afe9d560800 00000020:00000080:2.0:1789445759.583500:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789445759.584012:0:8583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8583:1876369742007296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789445759.584359:0:8583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445759.584404:0:8583:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d5b6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789445759.584486:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742007296 00000100:00100000:1.0:1789445759.584500:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742007296 00000100:00100000:1.0:1789445759.584576:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789445759.584589:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:8583:x1876369742007296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789445759.585385:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:8583:x1876369742007296:12345-0@lo:502:llog_process_th.0 Request processed in 793us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445759.585398:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789445759.586423:0:8583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:8583:1876369742007296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789445759.586483:0:8583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789445759.586494:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445759.586497:0:8583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789445759.586503:0:8583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789445759.586805:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789445759.586846:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789445759.586863:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57be400/0xc1b37c4d4725614e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256155 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445759.586889:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afeb57be400/0xc1b37c4d4725614e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256155 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445759.706338:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445760.730272:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445761.122251:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789445761.122275:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742007424:0@lo:400:kworker.0 00000100:00100000:1.0:1789445761.122340:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445761.122429:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742007424 00000100:00100000:0.0:1789445761.122437:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742007424 00000100:00100000:0.0:1789445761.122484:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789445761.122493:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3312:x1876369742007424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445761.122551:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3312:x1876369742007424:12345-0@lo:400:kworker.0 Request processed in 58us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445761.122558:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789445761.122597:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742007424:0@lo:400:kworker.0 00000100:00100000:3.0:1789445761.122757:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742007552:0@lo:400:kworker.0 00000100:00100000:3.0:1789445761.122830:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445761.122927:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742007552 00000100:00100000:0.0:1789445761.122931:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742007552 00000100:00100000:0.0:1789445761.122969:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789445761.122976:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742007552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445761.123129:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876369742007680:0@lo:400:kworker.0 00000100:00100000:1.0:1789445761.123153:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445761.123179:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742007680 00000100:00100000:1.0:1789445761.123182:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742007680 00000100:00100000:1.0:1789445761.123212:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789445761.123218:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876369742007680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445761.123245:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876369742007680:12345-0@lo:400:kworker.0 Request processed in 28us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445761.123251:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789445761.123278:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876369742007680:0@lo:400:kworker.0 00000100:00100000:0.0:1789445761.123417:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742007552:12345-0@lo:400:kworker.0 Request processed in 440us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445761.123424:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789445761.123459:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445761.123526:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742007552:0@lo:400:kworker.0 00000100:00100000:0.0:1789445761.123631:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742007808:0@lo:400:kworker.0 00000100:00100000:0.0:1789445761.123659:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445761.123793:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789445761.123799:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742007936:0@lo:400:kworker.0 00000100:00100000:0.0:1789445761.123820:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445761.123855:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789445761.123862:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742008064:0@lo:400:kworker.0 00000100:00100000:0.0:1789445761.123882:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445761.123914:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742007936 00000100:00100000:2.0:1789445761.123918:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742007936 00000100:00100000:2.0:1789445761.123970:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789445761.123977:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742007936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445761.124014:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742007936:12345-0@lo:400:kworker.0 Request processed in 39us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445761.124019:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789445761.124365:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789445761.124381:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742007936:0@lo:400:kworker.0 00000100:00100000:1.0:1789445761.124463:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742007808 00000100:00100000:1.0:1789445761.124468:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742007808 00000100:00100000:1.0:1789445761.124507:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742008064 00000100:00100000:1.0:1789445761.124510:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742008064 00000100:00100000:1.0:1789445761.124527:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789445761.124533:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742007808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445761.124569:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742007808:12345-0@lo:400:kworker.0 Request processed in 36us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445761.124575:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789445761.124595:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789445761.124601:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742008064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445761.124631:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742008064:12345-0@lo:400:kworker.0 Request processed in 30us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445761.124636:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789445761.124717:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789445761.124721:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789445761.124740:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb575f480 x1876369742008064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445761.124750:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742008064:0@lo:400:kworker.0 00010000:00080000:0.0:1789445761.125036:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb575ce00 x1876369742007808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445761.125273:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742007808:0@lo:400:kworker.0 00000100:00100000:2.0:1789445761.635730:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789445761.635761:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742008192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789445761.635861:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445761.635949:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742008192 00000100:00100000:2.0:1789445761.635968:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742008192 00000100:00100000:2.0:1789445761.636191:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789445761.636201:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742008192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789445761.636246:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789445761.636370:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742008192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445761.636380:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789445761.636435:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb575e680 x1876369742008192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445761.636456:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742008192:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789445761.757131:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445762.778788:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445763.803074:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445764.133326:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445764.133364:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445764.133386:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445764.133407:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445764.133436:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722055680 00000100:00100000:2.0:1789445764.133445:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722055680 00000100:00100000:2.0:1789445764.133503:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 194 00000100:00100000:2.0:1789445764.134887:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2377:x1876369722055680:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445764.134998:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2377:x1876369722055680:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 126us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445764.135007:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 194 00000100:00100000:2.0:1789445764.135070:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722055936 00000100:00100000:2.0:1789445764.135076:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722055936 00000100:00100000:2.0:1789445764.135193:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722056064 00000100:00100000:2.0:1789445764.135197:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722056064 00000100:00100000:2.0:1789445764.135219:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 18 00000100:00100000:2.0:1789445764.135227:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2377:x1876369722055936:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445764.135257:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2377:x1876369722055936:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 31us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445764.135263:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 18 00000100:00100000:2.0:1789445764.135275:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 19 00000100:00100000:2.0:1789445764.135281:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2377:x1876369722056064:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445764.135302:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2377:x1876369722056064:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 22us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445764.135308:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 19 00000100:00100000:2.0:1789445764.135326:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722055808 00000100:00100000:2.0:1789445764.135330:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722055808 00000100:00100000:2.0:1789445764.135357:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 34 00000100:00100000:2.0:1789445764.135364:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2377:x1876369722055808:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445764.135389:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2377:x1876369722055808:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 26us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445764.135394:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 34 00000100:00080000:2.0:1789445764.135414:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789445764.135423:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789445764.135426:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445764.186263:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789445764.186286:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742008320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789445764.186351:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445764.186423:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742008320 00000100:00100000:3.0:1789445764.186430:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742008320 00000100:00100000:3.0:1789445764.186482:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789445764.186491:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742008320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789445764.186525:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789445764.186568:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742008320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445764.186575:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789445764.186595:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789445764.186619:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf762300 x1876369742008320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445764.186649:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742008320:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789445764.830105:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789445764.888907:0:8800:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg659-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1789445765.851657:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445766.234207:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742008448:0@lo:400:kworker.0 00000100:00100000:2.0:1789445766.234228:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742008576:0@lo:400:kworker.0 00000100:00100000:0.0:1789445766.235627:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742008832:0@lo:400:kworker.0 00000100:00100000:2.0:1789445766.237348:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445766.237411:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742009088:0@lo:400:kworker.0 00000100:00100000:2.0:1789445766.237452:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445766.237484:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789445766.237490:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742008704:0@lo:400:kworker.0 00000100:00100000:2.0:1789445766.237512:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445766.237550:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742008576 00000100:00100000:2.0:1789445766.237557:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742008576 00000100:00100000:2.0:1789445766.237594:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742008704 00000100:00100000:2.0:1789445766.237597:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742008704 00000100:00100000:2.0:1789445766.237626:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789445766.237635:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742008576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445766.237683:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742008576:12345-0@lo:400:kworker.0 Request processed in 48us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445766.237689:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789445766.237707:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789445766.237713:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742008704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445766.239007:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445766.239078:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742008960:0@lo:400:kworker.0 00000100:00100000:1.0:1789445766.239118:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445766.239151:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742008448 00000100:00100000:1.0:1789445766.239157:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742008448 00000100:00100000:1.0:1789445766.239273:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789445766.239281:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742008448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445766.239327:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742008448:12345-0@lo:400:kworker.0 Request processed in 46us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445766.239334:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789445766.239448:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742008448:0@lo:400:kworker.0 00000100:00100000:2.0:1789445766.241642:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742008704:12345-0@lo:400:kworker.0 Request processed in 3921us (4119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445766.241657:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789445766.241694:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742008960 00000100:00100000:2.0:1789445766.241708:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742008960 00000100:00100000:2.0:1789445766.241806:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789445766.241814:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742008960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445766.241906:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742008960:12345-0@lo:400:kworker.0 Request processed in 93us (2787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445766.241912:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789445766.241943:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742009088 00000100:00100000:2.0:1789445766.241947:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742009088 00000100:00100000:2.0:1789445766.241977:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789445766.241983:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742009088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445766.242016:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742009088:12345-0@lo:400:kworker.0 Request processed in 33us (4563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445766.242022:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1789445766.242062:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789445766.242067:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445766.242222:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742008704:0@lo:400:kworker.0 00000100:00100000:2.0:1789445766.242236:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742008576:0@lo:400:kworker.0 00010000:00080000:2.0:1789445766.242248:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb575ce00 x1876369742009088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445766.242258:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742009088:0@lo:400:kworker.0 00000100:00100000:0.0:1789445766.243996:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445766.244208:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742008832 00000100:00100000:2.0:1789445766.244216:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742008832 00000100:00100000:2.0:1789445766.244274:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789445766.244283:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742008832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445766.244337:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742008832:12345-0@lo:400:kworker.0 Request processed in 55us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445766.244344:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1789445766.244383:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb575df80 x1876369742008832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445766.244404:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742008832:0@lo:400:kworker.0 00000100:00080000:0.0:1789445766.244457:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789445766.245125:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742008960:0@lo:400:kworker.0 00000100:00100000:0.0:1789445766.747021:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742009216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789445766.747113:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445766.747302:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742009216 00000100:00100000:2.0:1789445766.747310:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742009216 00000100:00100000:2.0:1789445766.747361:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789445766.747371:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742009216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789445766.747407:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789445766.747460:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742009216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445766.747467:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789445766.747561:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb575df80 x1876369742009216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445766.747579:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742009216:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789445766.882301:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445767.901461:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445768.922238:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445769.262241:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445769.262275:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445769.262313:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445769.262340:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445769.262366:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722056320 00000100:00100000:1.0:1789445769.262375:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722056320 00000100:00100000:1.0:1789445769.262433:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 38 00000100:00100000:1.0:1789445769.262445:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2377:x1876369722056320:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445769.262511:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2377:x1876369722056320:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 69us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445769.262519:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 38 00000100:00100000:1.0:1789445769.262540:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722056448 00000100:00100000:1.0:1789445769.262544:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722056448 00000100:00100000:1.0:1789445769.262568:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722056576 00000100:00100000:1.0:1789445769.262571:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722056576 00000100:00100000:1.0:1789445769.262588:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:1.0:1789445769.262595:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2373:x1876369722056448:12345-192.168.206.59@tcp:9:kworker.0 00000020:00000080:1.0:1789445769.262621:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47256091 00000100:00080000:1.0:1789445769.262631:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9afe9f981000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789445769.262669:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789445769.262839:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722056192 00000100:00100000:3.0:1789445769.262844:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722056192 00000100:00100000:3.0:1789445769.262874:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 196 00000100:00100000:3.0:1789445769.262883:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2377:x1876369722056192:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445769.262911:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2377:x1876369722056192:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 31us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445769.262928:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 196 00000100:00100000:1.0:1789445769.263266:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+2:2373:x1876369722056448:12345-192.168.206.59@tcp:9:kworker.0 Request processed in 669us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445769.263273:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:1.0:1789445769.263286:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00100000:1.0:1789445769.263294:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2373:x1876369722056576:12345-192.168.206.59@tcp:9:kworker.0 00000020:00000080:1.0:1789445769.263309:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47256098 00000100:00080000:1.0:1789445769.263315:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9afe9f982800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789445769.263335:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789445769.263496:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+2:2373:x1876369722056576:12345-192.168.206.59@tcp:9:kworker.0 Request processed in 202us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445769.263511:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00080000:1.0:1789445769.263529:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789445769.263533:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789445769.263535:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789445769.264439:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445769.264577:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445769.308737:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789445769.308767:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742009344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789445769.308830:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445769.308889:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742009344 00000100:00100000:0.0:1789445769.308896:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742009344 00000100:00100000:0.0:1789445769.308959:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789445769.308969:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742009344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789445769.309004:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789445769.309071:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742009344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445769.309078:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1789445769.309100:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789445769.309127:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeba62ad80 x1876369742009344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445769.309145:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742009344:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1789445769.899986:0:9045:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg659-server.virtnet: executing yml_node 00000001:00100000:0.0:1789445769.914347:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4a94602d-5f10-4cb2-abf8-c0de02603d85 00000020:00000080:0.0:1789445769.914355:0:6708:0:(genops.c:885:class_export_put()) final put ffff9afe9f983000/4a94602d-5f10-4cb2-abf8-c0de02603d85 00000020:00000080:2.0:1789445769.914426:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe9f983000/4a94602d-5f10-4cb2-abf8-c0de02603d85 for lustre-OST0000 00000020:00000080:2.0:1789445769.914472:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afe9f981000 for lustre-OST0000 00010000:00010000:1.0:1789445769.950923:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445770.973938:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445771.354746:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742009472:0@lo:400:kworker.0 00000100:00100000:0.0:1789445771.354816:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445771.354874:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742009984:0@lo:400:kworker.0 00000100:00100000:0.0:1789445771.354927:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445771.354956:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789445771.354963:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742009856:0@lo:400:kworker.0 00000100:00100000:0.0:1789445771.354986:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445771.355015:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742009984 00000100:00100000:0.0:1789445771.355022:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742009984 00000100:00100000:0.0:1789445771.355100:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789445771.355109:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742009984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445771.355158:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742009984:12345-0@lo:400:kworker.0 Request processed in 50us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445771.355165:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1789445771.355187:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789445771.355215:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742009984:0@lo:400:kworker.0 00000100:00100000:1.0:1789445771.355706:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742009600:0@lo:400:kworker.0 00000100:00100000:1.0:1789445771.355739:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445771.355769:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742010112:0@lo:400:kworker.0 00000100:00100000:1.0:1789445771.355791:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445771.355812:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789445771.355819:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742009728:0@lo:400:kworker.0 00000100:00100000:1.0:1789445771.355840:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445771.355869:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742009856 00000100:00100000:1.0:1789445771.355873:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742009856 00000100:00100000:1.0:1789445771.355917:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742010112 00000100:00100000:1.0:1789445771.355921:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742010112 00000100:00100000:1.0:1789445771.355940:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789445771.355947:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742009856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445771.355988:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742009856:12345-0@lo:400:kworker.0 Request processed in 42us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445771.355995:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789445771.356007:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789445771.356013:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742010112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445771.356065:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742010112:12345-0@lo:400:kworker.0 Request processed in 52us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445771.356082:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789445771.356103:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742009600 00000100:00100000:1.0:1789445771.356107:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742009600 00000100:00100000:1.0:1789445771.356127:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742009728 00000100:00100000:1.0:1789445771.356129:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742009728 00000100:00100000:1.0:1789445771.356149:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789445771.356155:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742009600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445771.356185:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742009600:12345-0@lo:400:kworker.0 Request processed in 31us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445771.356191:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789445771.356203:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789445771.356208:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742009728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445771.356246:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742009728:12345-0@lo:400:kworker.0 Request processed in 26us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445771.356253:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789445771.356341:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789445771.356345:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789445771.356347:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789445771.356374:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742009728:0@lo:400:kworker.0 00000100:00100000:1.0:1789445771.356516:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742009600:0@lo:400:kworker.0 00010000:00080000:1.0:1789445771.356535:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf761500 x1876369742010112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445771.356545:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742010112:0@lo:400:kworker.0 00010000:00080000:1.0:1789445771.356576:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf760e00 x1876369742009856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445771.356598:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742009856:0@lo:400:kworker.0 00000100:00100000:3.0:1789445771.356887:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742009472 00000100:00100000:3.0:1789445771.356892:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742009472 00000100:00100000:3.0:1789445771.356941:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789445771.356949:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742009472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445771.357003:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742009472:12345-0@lo:400:kworker.0 Request processed in 55us (2187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445771.357009:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789445771.357943:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742009472:0@lo:400:kworker.0 00000100:00100000:3.0:1789445771.868628:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789445771.868650:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742010240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789445771.868715:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445771.868843:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742010240 00000100:00100000:0.0:1789445771.868850:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742010240 00000100:00100000:0.0:1789445771.868895:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789445771.868920:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742010240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789445771.868953:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789445771.869005:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742010240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445771.869012:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789445771.869328:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb575ce00 x1876369742010240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445771.869348:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742010240:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789445771.994272:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789445772.439192:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4a94602d-5f10-4cb2-abf8-c0de02603d85 00000020:00000080:0.0:1789445772.439201:0:7638:0:(genops.c:885:class_export_put()) final put ffff9afe9f984000/4a94602d-5f10-4cb2-abf8-c0de02603d85 00000020:00000080:3.0:1789445772.439325:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe9f984000/4a94602d-5f10-4cb2-abf8-c0de02603d85 for lustre-OST0001 00000020:00000080:3.0:1789445772.439453:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afe9f982800 for lustre-OST0001 00010000:00010000:1.0:1789445773.019112:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789445773.826262:0:9237:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:2.0:1789445774.042254:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445774.377107:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445774.377206:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445774.377235:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722056832 00000100:00100000:2.0:1789445774.377244:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722056832 00000100:00080000:3.0:1789445774.377277:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445774.377314:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 42 00000100:00100000:2.0:1789445774.377325:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2377:x1876369722056832:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445774.377415:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2377:x1876369722056832:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 90us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445774.377543:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 42 00000100:00100000:0.0:1789445774.377665:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722056704 00000100:00100000:0.0:1789445774.377669:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722056704 00000100:00100000:0.0:1789445774.377700:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 198 00000100:00100000:0.0:1789445774.377717:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2377:x1876369722056704:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445774.377784:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2377:x1876369722056704:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 69us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445774.377792:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 198 00000100:00100000:2.0:1789445774.428527:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742010368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789445774.428590:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445774.428723:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742010368 00000100:00100000:0.0:1789445774.428731:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742010368 00000100:00100000:0.0:1789445774.428801:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789445774.428810:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742010368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789445774.428839:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789445774.428902:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789445774.434428:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742010368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5611us (5830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445774.434442:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789445774.435422:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf763100 x1876369742010368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445774.435446:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742010368:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789445775.066325:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445776.091671:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445776.474293:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742010624:0@lo:400:kworker.0 00000100:00100000:3.0:1789445776.474357:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445776.474405:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742011136:0@lo:400:kworker.0 00000100:00100000:3.0:1789445776.474429:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445776.474457:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789445776.474463:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742010752:0@lo:400:kworker.0 00000100:00100000:3.0:1789445776.474484:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445776.474553:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742010880:0@lo:400:kworker.0 00000100:00100000:0.0:1789445776.474582:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445776.474611:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789445776.474616:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742010496:0@lo:400:kworker.0 00000100:00100000:0.0:1789445776.474642:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445776.474664:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742011008:0@lo:400:kworker.0 00000100:00100000:0.0:1789445776.474684:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445776.474713:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742010624 00000100:00100000:0.0:1789445776.474720:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742010624 00000100:00100000:0.0:1789445776.474762:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742010752 00000100:00100000:0.0:1789445776.474766:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742010752 00000100:00100000:0.0:1789445776.474785:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742011008 00000100:00100000:0.0:1789445776.474788:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742011008 00000100:00100000:0.0:1789445776.474801:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789445776.474808:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742010624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445776.474864:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742010624:12345-0@lo:400:kworker.0 Request processed in 56us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445776.474871:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789445776.474901:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789445776.474907:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742010752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445776.474934:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742010752:12345-0@lo:400:kworker.0 Request processed in 27us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445776.474940:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789445776.474952:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789445776.474957:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742011008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445776.474989:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742011008:12345-0@lo:400:kworker.0 Request processed in 32us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445776.474994:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789445776.475011:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742010496 00000100:00100000:0.0:1789445776.475015:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742010496 00000100:00100000:0.0:1789445776.475037:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789445776.475070:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3312:x1876369742010496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445776.475102:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3312:x1876369742010496:12345-0@lo:400:kworker.0 Request processed in 59us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445776.475108:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1789445776.475141:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789445776.475167:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742010496:0@lo:400:kworker.0 00000100:00100000:0.0:1789445776.475179:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf763800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742011008:0@lo:400:kworker.0 00000100:00100000:0.0:1789445776.475205:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742010752:0@lo:400:kworker.0 00000100:00100000:0.0:1789445776.475225:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742010624:0@lo:400:kworker.0 00000100:00100000:3.0:1789445776.475308:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742011136 00000100:00100000:3.0:1789445776.475312:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742011136 00000100:00100000:3.0:1789445776.475339:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742010880 00000100:00100000:3.0:1789445776.475342:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742010880 00000100:00100000:3.0:1789445776.475354:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789445776.475360:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742011136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445776.475392:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742011136:12345-0@lo:400:kworker.0 Request processed in 33us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445776.475404:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789445776.475417:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789445776.475423:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742010880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445776.475454:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742010880:12345-0@lo:400:kworker.0 Request processed in 32us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445776.475460:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1789445776.475515:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789445776.475518:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789445776.475537:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf761500 x1876369742010880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445776.475548:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742010880:0@lo:400:kworker.0 00010000:00080000:0.0:1789445776.475569:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf762a00 x1876369742011136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445776.475577:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742011136:0@lo:400:kworker.0 00000001:02000400:0.0:1789445776.532448:0:9335:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000100:00100000:0.0:1789445776.986383:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789445776.986407:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742011264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789445776.986474:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445776.986705:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742011264 00000100:00100000:2.0:1789445776.986713:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742011264 00000100:00100000:2.0:1789445776.986776:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789445776.986786:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742011264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789445776.986838:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789445776.986903:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742011264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445776.986910:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789445776.987036:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb575c000 x1876369742011264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445776.987074:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742011264:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789445777.115165:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445778.138342:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445779.167084:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789445779.239379:0:9433:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:2.0:1789445779.491997:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445779.492221:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722056960 00000100:00100000:3.0:1789445779.492242:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722056960 00000100:00100000:3.0:1789445779.492304:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 200 00000100:00100000:3.0:1789445779.492316:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2374:x1876369722056960:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445779.492386:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445779.492402:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2374:x1876369722056960:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 89us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445779.492410:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 200 00000100:00100000:1.0:1789445779.492739:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722057088 00000100:00100000:1.0:1789445779.492745:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722057088 00000100:00100000:1.0:1789445779.492804:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 46 00000100:00100000:1.0:1789445779.492813:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2374:x1876369722057088:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445779.492882:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2374:x1876369722057088:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 60us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445779.492889:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 46 00000100:00080000:0.0:1789445779.492897:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789445779.546503:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742011392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789445779.546611:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445779.546924:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742011392 00000100:00100000:2.0:1789445779.546937:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742011392 00000100:00100000:2.0:1789445779.547026:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789445779.547037:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742011392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789445779.547098:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789445779.547894:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789445779.548381:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742011392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1338us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445779.548394:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789445779.548634:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afe9ee7dc00 x1876369742011392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445779.548663:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742011392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789445780.187139:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789445780.625697:0:9481:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 15 00:16:19 EDT 2026 00010000:00010000:3.0:1789445781.210238:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445781.594367:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742011520:0@lo:400:kworker.0 00000100:00100000:0.0:1789445781.594403:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742011648:0@lo:400:kworker.0 00000100:00100000:0.0:1789445781.594488:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445781.594489:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445781.594830:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742011904:0@lo:400:kworker.0 00000100:00100000:2.0:1789445781.595993:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445781.596021:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742012032:0@lo:400:kworker.0 00000100:00100000:2.0:1789445781.596068:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742011904 00000100:00100000:3.0:1789445781.596074:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445781.596077:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742011904 00000100:00100000:3.0:1789445781.596110:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742011648 00000100:00100000:3.0:1789445781.596114:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742011648 00000100:00100000:2.0:1789445781.596145:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789445781.596156:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742011904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445781.596162:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742012032 00000100:00100000:3.0:1789445781.596164:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742012032 00000100:00100000:2.0:1789445781.596224:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742011904:12345-0@lo:400:kworker.0 Request processed in 70us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445781.596232:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789445781.596243:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789445781.596251:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742011648:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789445781.596256:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789445781.596261:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445781.596298:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742011648:12345-0@lo:400:kworker.0 Request processed in 49us (1815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445781.596305:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789445781.596318:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1789445781.596323:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf761500 x1876369742011904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445781.596324:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742012032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445781.596340:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742011904:0@lo:400:kworker.0 00000100:00100000:3.0:1789445781.596361:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742012032:12345-0@lo:400:kworker.0 Request processed in 38us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445781.596367:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789445781.596411:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742012032:0@lo:400:kworker.0 00000100:00100000:0.0:1789445781.599104:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742011648:0@lo:400:kworker.0 00000100:00100000:0.0:1789445781.599147:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742012160:0@lo:400:kworker.0 00000100:00100000:0.0:1789445781.599222:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445781.599280:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789445781.599288:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742011776:0@lo:400:kworker.0 00000100:00100000:0.0:1789445781.599314:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445781.599449:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742012160 00000100:00100000:2.0:1789445781.599459:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742012160 00000100:00100000:2.0:1789445781.599529:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789445781.599541:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742012160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445781.599606:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742012160:12345-0@lo:400:kworker.0 Request processed in 66us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445781.599614:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1789445781.599638:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789445781.599665:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf760e00 x1876369742012160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445781.599676:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742012160:0@lo:400:kworker.0 00000100:00100000:3.0:1789445781.602367:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742011776 00000100:00100000:3.0:1789445781.602383:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742011776 00000100:00100000:3.0:1789445781.602469:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789445781.602481:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742011776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445781.602604:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742011776:12345-0@lo:400:kworker.0 Request processed in 126us (3287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445781.602612:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789445781.602684:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742011776:0@lo:400:kworker.0 00000100:00080000:1.0:1789445781.602889:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789445781.602978:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742011520 00000100:00100000:0.0:1789445781.602984:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742011520 00000100:00100000:0.0:1789445781.603019:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789445781.603027:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742011520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445781.603092:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742011520:12345-0@lo:400:kworker.0 Request processed in 66us (8608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445781.603099:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789445781.603180:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742011520:0@lo:400:kworker.0 00000100:00100000:3.0:1789445782.115932:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789445782.115959:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742012288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789445782.116135:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445782.116320:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742012288 00000100:00100000:0.0:1789445782.116331:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742012288 00000100:00100000:0.0:1789445782.116520:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789445782.116532:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742012288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789445782.116578:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789445782.116644:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742012288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445782.116651:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789445782.116743:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afe9ee7dc00 x1876369742012288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445782.116766:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742012288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789445782.241355:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445783.263004:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445784.285379:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445784.612114:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445784.612230:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445784.612391:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722057344 00000100:00100000:3.0:1789445784.612400:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722057344 00000100:00100000:2.0:1789445784.612538:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722057216 00000100:00100000:2.0:1789445784.612543:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722057216 00000100:00100000:2.0:1789445784.612588:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 202 00000100:00100000:2.0:1789445784.612597:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2375:x1876369722057216:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445784.612652:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 50 00000100:00100000:3.0:1789445784.612670:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2375:x1876369722057344:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445784.612670:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2375:x1876369722057216:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 75us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445784.612677:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 202 00000100:00100000:3.0:1789445784.612712:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2375:x1876369722057344:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 45us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445784.612718:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 50 00000100:00080000:0.0:1789445784.613071:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445784.675931:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742012416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789445784.675998:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445784.677063:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742012416 00000100:00100000:1.0:1789445784.677076:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742012416 00000100:00100000:1.0:1789445784.677140:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789445784.677156:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742012416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789445784.677192:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789445784.677297:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789445784.682767:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742012416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5604us (6760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445784.682781:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789445784.690514:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf762a00 x1876369742012416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445784.690555:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742012416:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789445785.308557:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445786.353909:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445786.716077:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742012672:0@lo:400:kworker.0 00000100:00100000:1.0:1789445786.716185:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445786.716384:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742012928:0@lo:400:kworker.0 00000100:00100000:3.0:1789445786.716527:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445786.716587:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789445786.716595:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742012544:0@lo:400:kworker.0 00000100:00100000:3.0:1789445786.716628:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445786.716723:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742013184:0@lo:400:kworker.0 00000100:00100000:1.0:1789445786.716749:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445786.716819:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742013056:0@lo:400:kworker.0 00000100:00100000:3.0:1789445786.716862:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445786.716898:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742012672 00000100:00100000:3.0:1789445786.716908:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742012672 00000100:00100000:3.0:1789445786.716960:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742013056 00000100:00100000:3.0:1789445786.716964:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742013056 00000100:00100000:3.0:1789445786.716992:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789445786.717000:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742012672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445786.717066:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742012672:12345-0@lo:400:kworker.0 Request processed in 67us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445786.717073:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789445786.717103:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789445786.717110:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742013056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445786.717142:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742013056:12345-0@lo:400:kworker.0 Request processed in 33us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445786.717148:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789445786.717257:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742012672:0@lo:400:kworker.0 00000100:00100000:1.0:1789445786.717275:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789445786.717281:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742012800:0@lo:400:kworker.0 00000100:00100000:1.0:1789445786.717315:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445786.722172:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742012928 00000100:00100000:0.0:1789445786.722195:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742012928 00000100:00100000:1.0:1789445786.722613:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789445786.722631:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742012928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445786.722763:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742012928:12345-0@lo:400:kworker.0 Request processed in 138us (6235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445786.722771:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789445786.722897:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742013184 00000100:00100000:0.0:1789445786.722904:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742013184 00000100:00100000:0.0:1789445786.722943:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789445786.722951:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742013184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445786.723002:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742013184:12345-0@lo:400:kworker.0 Request processed in 52us (6251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445786.723008:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789445786.723270:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4fdc000 x1876369742013184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445786.723288:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742013184:0@lo:400:kworker.0 00000100:00100000:3.0:1789445786.724845:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742012544 00000100:00100000:3.0:1789445786.724859:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742012544 00000100:00100000:3.0:1789445786.724923:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789445786.724935:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3312:x1876369742012544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445786.725022:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3312:x1876369742012544:12345-0@lo:400:kworker.0 Request processed in 90us (8393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445786.725028:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789445786.726945:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742012800 00000100:00100000:3.0:1789445786.726961:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742012800 00000100:00100000:3.0:1789445786.727014:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789445786.727026:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742012800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445786.727144:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742012800:12345-0@lo:400:kworker.0 Request processed in 121us (9827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445786.727152:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1789445786.727181:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789445786.727187:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789445786.727190:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445786.727232:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742012544:0@lo:400:kworker.0 00000100:00100000:3.0:1789445786.727252:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742013056:0@lo:400:kworker.0 00010000:00080000:3.0:1789445786.727266:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb5c79500 x1876369742012928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445786.727277:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742012928:0@lo:400:kworker.0 00000100:00100000:0.0:1789445786.727561:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742012800:0@lo:400:kworker.0 00000100:00100000:0.0:1789445787.227727:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742013312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789445787.227822:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445787.227976:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742013312 00000100:00100000:1.0:1789445787.227986:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742013312 00000100:00100000:1.0:1789445787.228070:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789445787.228081:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742013312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789445787.228123:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445787.228179:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742013312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445787.228196:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1789445787.228421:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4fde680 x1876369742013312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445787.228444:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742013312:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789445787.354552:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445788.382894:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445789.402746:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445789.729675:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445789.729727:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445789.729804:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722057472 00000100:00100000:0.0:1789445789.729817:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722057472 00000100:00100000:0.0:1789445789.729897:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 204 00000100:00100000:0.0:1789445789.729908:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2376:x1876369722057472:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445789.730007:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2376:x1876369722057472:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 99us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445789.730015:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 204 00000100:00100000:3.0:1789445789.731189:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722057600 00000100:00100000:3.0:1789445789.731204:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722057600 00000100:00100000:3.0:1789445789.731299:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 54 00000100:00100000:3.0:1789445789.731311:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2376:x1876369722057600:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445789.731395:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2376:x1876369722057600:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 87us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445789.731402:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 54 00000100:00080000:1.0:1789445789.731593:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445789.787084:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742013440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789445789.787175:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445789.787453:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742013440 00000100:00100000:2.0:1789445789.787464:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742013440 00000100:00100000:2.0:1789445789.787537:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789445789.787548:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742013440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789445789.787595:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789445789.788702:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742013440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1148us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445789.788715:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1789445789.788749:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789445789.789902:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf762a00 x1876369742013440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445789.789936:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742013440:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789445790.430718:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445791.452168:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445791.839399:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742013568:0@lo:400:kworker.0 00000100:00100000:1.0:1789445791.839509:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445791.839564:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742014080:0@lo:400:kworker.0 00000100:00100000:1.0:1789445791.839594:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445791.839638:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789445791.839645:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742013952:0@lo:400:kworker.0 00000100:00100000:1.0:1789445791.839673:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445791.839709:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742013696:0@lo:400:kworker.0 00000100:00100000:1.0:1789445791.839733:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445791.839754:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742014208:0@lo:400:kworker.0 00000100:00100000:1.0:1789445791.839777:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445791.839795:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789445791.839801:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742013824:0@lo:400:kworker.0 00000100:00100000:1.0:1789445791.839833:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445791.839871:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742013568 00000100:00100000:1.0:1789445791.839881:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742013568 00000100:00100000:1.0:1789445791.839943:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789445791.839951:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742013568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445791.840005:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742013568:12345-0@lo:400:kworker.0 Request processed in 54us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445791.840026:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789445791.840083:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742014080 00000100:00100000:1.0:1789445791.840087:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742014080 00000100:00100000:1.0:1789445791.840131:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742013696 00000100:00100000:1.0:1789445791.840133:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742013696 00000100:00100000:1.0:1789445791.840144:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742013824 00000100:00100000:1.0:1789445791.840146:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742013824 00000100:00080000:2.0:1789445791.840194:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445791.840211:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789445791.840221:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742014080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445791.840260:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742014080:12345-0@lo:400:kworker.0 Request processed in 42us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445791.840267:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789445791.840281:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789445791.840287:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742013696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445791.840320:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742013696:12345-0@lo:400:kworker.0 Request processed in 33us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445791.840325:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789445791.840527:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789445791.840534:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742013824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445791.840565:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742013824:12345-0@lo:400:kworker.0 Request processed in 32us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445791.840572:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789445791.840592:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742013952 00000100:00100000:1.0:1789445791.840596:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742013952 00000100:00100000:2.0:1789445791.840866:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742013696:0@lo:400:kworker.0 00000100:00100000:2.0:1789445791.840899:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742013824:0@lo:400:kworker.0 00000100:00100000:1.0:1789445791.841244:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742014208 00000100:00100000:1.0:1789445791.841249:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742014208 00000100:00100000:1.0:1789445791.841273:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789445791.841280:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742013952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445791.841323:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742013952:12345-0@lo:400:kworker.0 Request processed in 44us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445791.841329:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789445791.841340:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789445791.841346:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742014208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445791.841392:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742014208:12345-0@lo:400:kworker.0 Request processed in 46us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445791.841398:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789445791.841739:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789445791.841753:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789445791.841756:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789445791.841790:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4fdca80 x1876369742013952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445791.841803:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742013952:0@lo:400:kworker.0 00000100:00100000:1.0:1789445791.841826:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742013568:0@lo:400:kworker.0 00000100:00100000:1.0:1789445791.841838:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742014080:0@lo:400:kworker.0 00010000:00080000:2.0:1789445791.841923:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4fdc380 x1876369742014208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445791.841933:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742014208:0@lo:400:kworker.0 00000100:00100000:1.0:1789445792.346203:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742014336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789445792.346263:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445792.346336:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742014336 00000100:00100000:1.0:1789445792.346343:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742014336 00000100:00100000:1.0:1789445792.346381:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789445792.346388:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742014336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789445792.346418:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445792.346455:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742014336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445792.346461:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1789445792.346500:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4fdc700 x1876369742014336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445792.346518:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742014336:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789445792.489259:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445793.498262:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445794.528486:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789445794.585913:0:10112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 00:16:33 (1789445793) === 00000100:00100000:2.0:1789445794.850419:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445794.850476:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445794.850718:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722057728 00000100:00100000:0.0:1789445794.850731:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722057728 00000100:00100000:0.0:1789445794.850822:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 206 00000100:00100000:0.0:1789445794.850834:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2375:x1876369722057728:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445794.850938:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2375:x1876369722057728:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 105us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445794.850946:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 206 00000100:00100000:1.0:1789445794.851339:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722057856 00000100:00100000:1.0:1789445794.851347:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722057856 00000100:00100000:1.0:1789445794.851420:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 58 00000100:00100000:1.0:1789445794.851430:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2375:x1876369722057856:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445794.851497:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2375:x1876369722057856:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 70us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445794.851504:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 58 00000100:00080000:0.0:1789445794.851961:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789445794.906543:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742014464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789445794.906654:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445794.906813:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742014464 00000100:00100000:0.0:1789445794.906823:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742014464 00000100:00100000:0.0:1789445794.906919:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789445794.906920:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789445794.906933:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742014464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789445794.906979:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789445794.907029:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742014464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445794.907037:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789445794.907256:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf762a00 x1876369742014464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445794.907680:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742014464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789445795.045395:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445795.045540:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722057984 00000100:00100000:0.0:1789445795.045555:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722057984 00000100:00100000:0.0:1789445795.045675:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 207 00000100:00100000:0.0:1789445795.045688:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:8173:x1876369722057984:12345-192.168.206.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789445795.045710:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445795.045735:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe8e988200/0xc1b37c4d4725615c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4a73 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445795.045782:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe8e988200/0xc1b37c4d4725615c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a73 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445795.045808:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe8e988200/0xc1b37c4d4725615c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a73 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445795.045852:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e988200, rc 0) 00000100:00100000:0.0:1789445795.046069:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+11:8173:x1876369722057984:12345-192.168.206.59@tcp:101:mount.lustre.0 Request processed in 356us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445795.046082:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 207 00000100:00100000:1.0:1789445795.053698:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445795.054693:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722058112 00000100:00100000:2.0:1789445795.054710:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722058112 00000100:00100000:2.0:1789445795.054790:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 208 00000100:00100000:2.0:1789445795.054815:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+11:8173:x1876369722058112:12345-192.168.206.59@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789445795.055325:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+11:8173:x1876369722058112:12345-192.168.206.59@tcp:501:mount.lustre.0 Request processed in 510us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445795.055336:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 208 00000100:00100000:2.0:1789445795.059760:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445795.062830:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722058240 00000100:00100000:0.0:1789445795.062853:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722058240 00000100:00100000:0.0:1789445795.063428:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 209 00000100:00100000:0.0:1789445795.063443:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+11:8173:x1876369722058240:12345-192.168.206.59@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789445795.063753:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+11:8173:x1876369722058240:12345-192.168.206.59@tcp:503:mount.lustre.0 Request processed in 312us (4005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445795.063762:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 209 00000100:00100000:3.0:1789445795.070675:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445795.070767:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722058368 00000100:00100000:0.0:1789445795.070780:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722058368 00000100:00100000:1.0:1789445795.070973:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 210 00000100:00100000:1.0:1789445795.070991:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+11:8177:x1876369722058368:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789445795.071620:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+11:8177:x1876369722058368:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 630us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445795.071632:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 210 00000100:00100000:3.0:1789445795.091484:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445795.092315:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722058496 00000100:00100000:1.0:1789445795.092332:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722058496 00000100:00100000:1.0:1789445795.092425:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 211 00000100:00100000:1.0:1789445795.092438:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+11:8177:x1876369722058496:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789445795.092816:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+11:8177:x1876369722058496:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 379us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445795.092825:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 211 00000100:00100000:2.0:1789445795.099034:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445795.099241:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722058624 00000100:00100000:0.0:1789445795.099255:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722058624 00000100:00100000:0.0:1789445795.099330:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 212 00000100:00100000:0.0:1789445795.099341:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+11:8173:x1876369722058624:12345-192.168.206.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789445795.099364:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445795.099387:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe8e988a00/0xc1b37c4d47256163 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4a9d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445795.099423:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe8e988a00/0xc1b37c4d47256163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a9d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445795.099437:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe8e988a00/0xc1b37c4d47256163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a9d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445795.099473:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e988a00, rc 0) 00000100:00100000:0.0:1789445795.099561:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:8173:x1876369722058624:12345-192.168.206.59@tcp:101:mount.lustre.0 Request processed in 221us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445795.100163:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 212 00000100:00100000:3.0:1789445795.102562:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445795.102774:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722058752 00000100:00100000:0.0:1789445795.102788:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722058752 00000100:00100000:0.0:1789445795.102869:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 213 00000100:00100000:0.0:1789445795.102882:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:8173:x1876369722058752:12345-192.168.206.59@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789445795.102914:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789445795.102949:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789445795.102954:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789445795.102957:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789445795.102960:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789445795.104895:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:8173:x1876369722058752:12345-192.168.206.59@tcp:256:mount.lustre.0 Request processed in 2002us (2333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445795.104912:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 213 00000100:00100000:3.0:1789445795.112661:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445795.112898:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722058880 00000100:00100000:1.0:1789445795.112912:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722058880 00000100:00100000:1.0:1789445795.112986:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 214 00000100:00100000:1.0:1789445795.113016:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:8173:x1876369722058880:12345-192.168.206.59@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789445795.113040:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445795.113104:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe81678400/0xc1b37c4d4725616a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4aa4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445795.113151:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe81678400/0xc1b37c4d4725616a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4aa4 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445795.113164:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe81678400/0xc1b37c4d4725616a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4aa4 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445795.113173:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe81678400, rc 0) 00000100:00100000:1.0:1789445795.113239:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:8173:x1876369722058880:12345-192.168.206.59@tcp:101:mount.lustre.0 Request processed in 226us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445795.113247:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 214 00000100:00100000:3.0:1789445795.115470:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445795.115572:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722059008 00000100:00100000:0.0:1789445795.115584:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722059008 00000100:00100000:0.0:1789445795.115653:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 215 00000100:00100000:0.0:1789445795.115664:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:8173:x1876369722059008:12345-192.168.206.59@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789445795.116027:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:8173:x1876369722059008:12345-192.168.206.59@tcp:501:mount.lustre.0 Request processed in 363us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445795.116036:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 215 00000100:00100000:3.0:1789445795.121370:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445795.121599:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722059136 00000100:00100000:0.0:1789445795.121622:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722059136 00000100:00100000:0.0:1789445795.121712:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 216 00000100:00100000:0.0:1789445795.121725:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:8173:x1876369722059136:12345-192.168.206.59@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789445795.122012:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:8173:x1876369722059136:12345-192.168.206.59@tcp:503:mount.lustre.0 Request processed in 290us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445795.122021:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 216 00000100:00100000:2.0:1789445795.129966:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445795.130260:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722059264 00000100:00100000:1.0:1789445795.130275:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722059264 00000100:00100000:1.0:1789445795.130346:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 217 00000100:00100000:1.0:1789445795.130359:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:8179:x1876369722059264:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789445795.130865:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:8179:x1876369722059264:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 506us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445795.130875:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 217 00000100:00100000:3.0:1789445795.137704:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445795.137870:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722059392 00000100:00100000:1.0:1789445795.137884:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722059392 00000100:00100000:1.0:1789445795.137942:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 218 00000100:00100000:1.0:1789445795.137954:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:8179:x1876369722059392:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789445795.138312:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:8179:x1876369722059392:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 358us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445795.138328:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 218 00000100:00100000:3.0:1789445795.147617:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445795.147811:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722059520 00000100:00100000:1.0:1789445795.147823:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722059520 00000100:00100000:1.0:1789445795.147880:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:1.0:1789445795.147890:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2373:x1876369722059520:12345-192.168.206.59@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789445795.147926:0:5840:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 338e572d-37d9-47c3-87b6-4735cd889844@192.168.206.59@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:1.0:1789445795.147971:0:5840:0:(genops.c:1384:class_connect()) connect: client 338e572d-37d9-47c3-87b6-4735cd889844, cookie 0xc1b37c4d47256171 00000004:00100000:1.0:1789445795.148011:0:5840:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789445795.149011:0:5840:0:(import.c:65:import_set_state_nolock()) ffff9afeba7a5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789445795.150481:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:338e572d-37d9-47c3-87b6-4735cd889844+6:2373:x1876369722059520:12345-192.168.206.59@tcp:38:mount.lustre.0 Request processed in 2577us (2866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445795.150499:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:2.0:1789445795.161596:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445795.161640:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445795.161853:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722059776 00000100:00100000:3.0:1789445795.161854:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722059648 00000100:00100000:3.0:1789445795.161866:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722059648 00000100:00100000:1.0:1789445795.161866:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722059776 00000100:00080000:2.0:1789445795.161932:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789445795.161948:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00100000:1.0:1789445795.161961:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:338e572d-37d9-47c3-87b6-4735cd889844+7:8173:x1876369722059776:12345-192.168.206.59@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789445795.162021:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789445795.162090:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 12 00000100:00100000:3.0:1789445795.162101:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+7:0:x1876369722059648:12345-192.168.206.59@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789445795.162114:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789445795.162207:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:338e572d-37d9-47c3-87b6-4735cd889844+7:8173:x1876369722059776:12345-192.168.206.59@tcp:41:mount.lustre.0 Request processed in 248us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445795.162215:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00100000:3.0:1789445795.162240:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+6:0:x1876369722059648:12345-192.168.206.59@tcp:41:mount.lustre.0 Request processed in 143us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445795.162267:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 12 00000100:00100000:1.0:1789445795.164897:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445795.165036:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722059904 00000100:00100000:0.0:1789445795.165127:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722059904 00000100:00100000:0.0:1789445795.165262:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 13 00000100:00100000:0.0:1789445795.165274:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:338e572d-37d9-47c3-87b6-4735cd889844+6:8173:x1876369722059904:12345-192.168.206.59@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789445795.165563:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:338e572d-37d9-47c3-87b6-4735cd889844+6:8173:x1876369722059904:12345-192.168.206.59@tcp:40:mount.lustre.0 Request processed in 290us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445795.165572:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 13 00000100:00100000:2.0:1789445795.168102:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445795.168279:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445795.168628:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445795.168841:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722060288 00000100:00100000:0.0:1789445795.168854:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722060288 00000100:00100000:0.0:1789445795.168920:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 1 00000100:00100000:0.0:1789445795.168931:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:338e572d-37d9-47c3-87b6-4735cd889844+6:8173:x1876369722060288:12345-192.168.206.59@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789445795.169041:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789445795.169282:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:338e572d-37d9-47c3-87b6-4735cd889844+6:8173:x1876369722060288:12345-192.168.206.59@tcp:33:mount.lustre.0 Request processed in 353us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445795.169291:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 1 00000100:00100000:1.0:1789445795.170697:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722060032 00000100:00100000:1.0:1789445795.170716:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722060032 00000100:00100000:1.0:1789445795.170908:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722060160 00000100:00100000:1.0:1789445795.170912:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722060160 00000100:00100000:1.0:1789445795.170965:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 12 00000100:00100000:1.0:1789445795.170975:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2373:x1876369722060032:12345-192.168.206.59@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789445795.171015:0:6685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 338e572d-37d9-47c3-87b6-4735cd889844@192.168.206.59@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:1.0:1789445795.171087:0:6685:0:(genops.c:1384:class_connect()) connect: client 338e572d-37d9-47c3-87b6-4735cd889844, cookie 0xc1b37c4d47256178 00002000:00100000:1.0:1789445795.171102:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 338e572d-37d9-47c3-87b6-4735cd889844/ffff9afeba7a4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789445795.171116:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789445795.171544:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789445795.171587:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9afeba7a6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789445795.171938:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:338e572d-37d9-47c3-87b6-4735cd889844+6:2373:x1876369722060032:12345-192.168.206.59@tcp:8:mount.lustre.0 Request processed in 961us (3849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445795.171957:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 12 00000100:00100000:1.0:1789445795.171992:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 13 00000100:00100000:1.0:1789445795.171998:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2373:x1876369722060160:12345-192.168.206.59@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789445795.172021:0:6685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 338e572d-37d9-47c3-87b6-4735cd889844@192.168.206.59@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:1.0:1789445795.172085:0:6685:0:(genops.c:1384:class_connect()) connect: client 338e572d-37d9-47c3-87b6-4735cd889844, cookie 0xc1b37c4d4725617f 00002000:00100000:1.0:1789445795.172094:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 338e572d-37d9-47c3-87b6-4735cd889844/ffff9afebfa4d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789445795.172119:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789445795.172271:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789445795.172290:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9afebfa49000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789445795.172317:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:338e572d-37d9-47c3-87b6-4735cd889844+6:2373:x1876369722060160:12345-192.168.206.59@tcp:8:mount.lustre.0 Request processed in 318us (4038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445795.172325:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 13 00000001:00100000:2.0:1789445795.447707:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 338e572d-37d9-47c3-87b6-4735cd889844 00010000:00010000:0.0:1789445795.553370:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445796.570187:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445796.955344:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742014592:0@lo:400:kworker.0 00000100:00100000:2.0:1789445796.955436:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445796.955497:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742015104:0@lo:400:kworker.0 00000100:00100000:2.0:1789445796.955524:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445796.955556:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789445796.955562:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742014976:0@lo:400:kworker.0 00000100:00100000:2.0:1789445796.955603:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445796.955640:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742015104 00000100:00100000:2.0:1789445796.955648:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742015104 00000100:00100000:2.0:1789445796.955712:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789445796.955723:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742015104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445796.955783:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742015104:12345-0@lo:400:kworker.0 Request processed in 62us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445796.955806:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1789445796.955833:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445796.955872:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742015104:0@lo:400:kworker.0 00000100:00100000:0.0:1789445796.956021:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742014592 00000100:00100000:0.0:1789445796.956026:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742014592 00000100:00100000:0.0:1789445796.956086:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789445796.956094:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742014592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445796.957557:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742014592:12345-0@lo:400:kworker.0 Request processed in 1455us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445796.957573:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742014592:0@lo:400:kworker.0 00000100:00100000:0.0:1789445796.957592:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789445796.958367:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742014720:0@lo:400:kworker.0 00000100:00100000:0.0:1789445796.958429:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445796.958476:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742015232:0@lo:400:kworker.0 00000100:00100000:0.0:1789445796.958506:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445796.958537:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789445796.958544:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742014848:0@lo:400:kworker.0 00000100:00100000:0.0:1789445796.958570:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445796.958605:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742014976 00000100:00100000:0.0:1789445796.958614:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742014976 00000100:00100000:0.0:1789445796.958669:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742015232 00000100:00100000:0.0:1789445796.958672:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742015232 00000100:00100000:0.0:1789445796.958690:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789445796.958699:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742014976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445796.958725:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742014720 00000100:00100000:2.0:1789445796.958731:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742014720 00000100:00100000:0.0:1789445796.958760:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742014976:12345-0@lo:400:kworker.0 Request processed in 62us (3155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445796.958770:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789445796.958795:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789445796.958803:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742015232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445796.958837:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742015232:12345-0@lo:400:kworker.0 Request processed in 35us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445796.958844:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789445796.958858:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742014848 00000100:00100000:2.0:1789445796.958863:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742014848 00000100:00100000:0.0:1789445796.958872:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789445796.958883:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742014720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445796.958901:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789445796.958910:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742014848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445796.958922:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742014720:12345-0@lo:400:kworker.0 Request processed in 41us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445796.958941:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789445796.958956:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742014848:12345-0@lo:400:kworker.0 Request processed in 47us (384us total) trans 0 rc 0/0 00000100:00080000:0.0:1789445796.958970:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789445796.958977:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789445796.958979:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789445796.959005:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742014848:0@lo:400:kworker.0 00000100:00100000:0.0:1789445796.959019:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742014720:0@lo:400:kworker.0 00010000:00080000:0.0:1789445796.959034:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf50ed80 x1876369742015232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445796.959067:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742015232:0@lo:400:kworker.0 00010000:00080000:0.0:1789445796.959117:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeba628000 x1876369742014976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445796.959133:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742014976:0@lo:400:kworker.0 00000100:00100000:2.0:1789445796.959237:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789445797.466264:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742015360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789445797.466342:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445797.466443:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742015360 00000100:00100000:0.0:1789445797.466450:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742015360 00000100:00100000:0.0:1789445797.466496:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789445797.466505:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742015360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789445797.466538:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789445797.481319:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742015360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 14806us (14969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445797.481336:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1789445797.481583:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4fdd180 x1876369742015360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445797.481606:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742015360:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789445797.596704:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789445798.028416:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 338e572d-37d9-47c3-87b6-4735cd889844 00010000:00010000:0.0:1789445798.618293:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789445799.088737:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 338e572d-37d9-47c3-87b6-4735cd889844 00010000:00010000:2.0:1789445799.642962:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445800.027301:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789445800.027321:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742015488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789445800.027384:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445800.027995:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742015488 00000100:00100000:1.0:1789445800.028003:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742015488 00000100:00100000:1.0:1789445800.028094:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789445800.028103:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742015488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789445800.028137:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445800.028186:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742015488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445800.028192:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789445800.028238:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4fdf100 x1876369742015488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445800.028257:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742015488:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789445800.028438:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445800.484850:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445800.484884:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445800.484907:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445800.484923:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445800.484945:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445800.484967:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722060800 00000100:00100000:3.0:1789445800.484975:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722060800 00000100:00100000:3.0:1789445800.485023:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722060928 00000100:00100000:3.0:1789445800.485025:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722060928 00000100:00100000:3.0:1789445800.485039:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 34 00000100:00100000:3.0:1789445800.485069:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2377:x1876369722060800:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445800.485131:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2377:x1876369722060800:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 63us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445800.485138:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 34 00000100:00100000:3.0:1789445800.485154:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 35 00000100:00100000:3.0:1789445800.485161:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2377:x1876369722060928:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445800.485186:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2377:x1876369722060928:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 26us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445800.485192:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 35 00000100:00100000:3.0:1789445800.485210:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722060416 00000100:00100000:3.0:1789445800.485221:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722060416 00000100:00100000:3.0:1789445800.485247:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 220 00000100:00100000:3.0:1789445800.485253:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2377:x1876369722060416:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445800.485290:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2377:x1876369722060416:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 37us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445800.485296:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 220 00000100:00080000:3.0:1789445800.485323:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789445800.485327:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789445800.485476:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722060544 00000100:00100000:1.0:1789445800.485481:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722060544 00000100:00100000:1.0:1789445800.485524:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722060672 00000100:00100000:1.0:1789445800.485528:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722060672 00000100:00100000:1.0:1789445800.485550:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 62 00000100:00100000:1.0:1789445800.485557:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2377:x1876369722060544:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445800.485591:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2377:x1876369722060544:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 34us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445800.485597:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 62 00000100:00100000:1.0:1789445800.485608:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 63 00000100:00100000:1.0:1789445800.485615:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:338e572d-37d9-47c3-87b6-4735cd889844+5:2377:x1876369722060672:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445800.485638:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:338e572d-37d9-47c3-87b6-4735cd889844+5:2377:x1876369722060672:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 24us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445800.485644:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 63 00000100:00080000:3.0:1789445800.485841:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1789445800.558278:0:10309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg659-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1789445800.669880:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445801.695174:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445802.079486:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742015616:0@lo:400:kworker.0 00000100:00100000:1.0:1789445802.079578:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445802.079683:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742015616 00000100:00100000:2.0:1789445802.079693:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742015616 00000100:00100000:2.0:1789445802.079739:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789445802.079747:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742015616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445802.081169:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742015744:0@lo:400:kworker.0 00000100:00100000:0.0:1789445802.081219:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445802.081250:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789445802.081256:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742015872:0@lo:400:kworker.0 00000100:00100000:0.0:1789445802.081277:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445802.081304:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742015744 00000100:00100000:0.0:1789445802.081309:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742015744 00000100:00100000:0.0:1789445802.081340:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742015872 00000100:00100000:0.0:1789445802.081343:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742015872 00000100:00100000:0.0:1789445802.081371:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789445802.081378:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742015744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445802.081423:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742015744:12345-0@lo:400:kworker.0 Request processed in 45us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445802.081429:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789445802.081447:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789445802.081453:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742015872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445802.081480:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742015872:12345-0@lo:400:kworker.0 Request processed in 28us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445802.081486:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789445802.081527:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742015872:0@lo:400:kworker.0 00000100:00100000:0.0:1789445802.081537:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742015744:0@lo:400:kworker.0 00000100:00100000:0.0:1789445802.081574:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742016000:0@lo:400:kworker.0 00000100:00100000:0.0:1789445802.081610:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445802.081708:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742016000 00000100:00100000:0.0:1789445802.081711:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742016000 00000100:00100000:0.0:1789445802.081737:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789445802.081743:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742016000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445802.081792:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742016000:12345-0@lo:400:kworker.0 Request processed in 48us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445802.081798:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789445802.081812:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789445802.081816:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789445802.081832:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeba655880 x1876369742016000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445802.081842:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742016000:0@lo:400:kworker.0 00000100:00100000:2.0:1789445802.091469:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742015616:12345-0@lo:400:kworker.0 Request processed in 11713us (11881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445802.091483:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789445802.094473:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742015616:0@lo:400:kworker.0 00000100:00100000:3.0:1789445802.100554:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789445802.100576:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742016128:0@lo:400:kworker.0 00000100:00100000:3.0:1789445802.100638:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445802.100682:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742016128 00000100:00100000:3.0:1789445802.100689:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742016128 00000100:00100000:3.0:1789445802.100743:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789445802.100753:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742016128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445802.100811:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742016128:12345-0@lo:400:kworker.0 Request processed in 60us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445802.100819:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1789445802.100839:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445802.100865:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742016128:0@lo:400:kworker.0 00000100:00100000:3.0:1789445802.100906:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742016256:0@lo:400:kworker.0 00000100:00100000:3.0:1789445802.100932:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445802.100975:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742016256 00000100:00100000:3.0:1789445802.100980:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742016256 00000100:00100000:3.0:1789445802.101008:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789445802.101014:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742016256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445802.101092:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742016256:12345-0@lo:400:kworker.0 Request processed in 78us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445802.101099:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789445802.101114:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789445802.101134:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeba656a00 x1876369742016256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445802.101144:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742016256:0@lo:400:kworker.0 00000100:00100000:3.0:1789445802.591769:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742016384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789445802.591884:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445802.592076:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742016384 00000100:00100000:2.0:1789445802.592155:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742016384 00000100:00100000:2.0:1789445802.592303:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789445802.592314:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742016384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789445802.592350:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789445802.601266:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742016384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8942us (9369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445802.601284:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1789445802.601675:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4fdf100 x1876369742016384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445802.601710:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742016384:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789445802.714638:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445803.739322:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445804.762332:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445805.146282:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789445805.146316:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742016512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789445805.146410:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445805.146546:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742016512 00000100:00100000:1.0:1789445805.146767:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742016512 00000100:00080000:3.0:1789445805.146876:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789445805.146925:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789445805.146938:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742016512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789445805.146983:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445805.147067:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742016512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445805.147076:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789445805.147431:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4fdd500 x1876369742016512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445805.147454:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742016512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789445805.604241:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445805.604293:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445805.604327:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445805.604348:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445805.604379:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445805.604428:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722061312 00000100:00100000:1.0:1789445805.604505:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722061312 00000100:00100000:1.0:1789445805.604645:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722061184 00000100:00100000:1.0:1789445805.604649:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722061184 00000100:00100000:1.0:1789445805.604680:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 67 00000100:00100000:1.0:1789445805.604691:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2374:x1876369722061312:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445805.604795:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2374:x1876369722061312:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 105us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445805.604803:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 67 00000100:00100000:1.0:1789445805.604824:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 68 00000100:00100000:1.0:1789445805.604831:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2374:x1876369722061184:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445805.604860:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2374:x1876369722061184:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 29us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445805.604875:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 68 00000100:00100000:1.0:1789445805.604902:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722061568 00000100:00100000:1.0:1789445805.604906:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722061568 00000100:00100000:1.0:1789445805.604938:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722061440 00000100:00100000:1.0:1789445805.604941:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722061440 00000100:00100000:1.0:1789445805.604961:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 38 00000100:00100000:1.0:1789445805.604968:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2374:x1876369722061568:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445805.605002:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2374:x1876369722061568:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 34us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445805.605009:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 38 00000100:00100000:1.0:1789445805.605022:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 39 00000100:00100000:1.0:1789445805.605029:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2374:x1876369722061440:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445805.605082:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2374:x1876369722061440:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 54us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445805.605089:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 39 00000100:00080000:1.0:1789445805.605107:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789445805.605111:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789445805.605114:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445805.605345:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722061056 00000100:00100000:2.0:1789445805.605352:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722061056 00000100:00100000:2.0:1789445805.605394:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 222 00000100:00100000:2.0:1789445805.605402:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2374:x1876369722061056:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445805.605452:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2374:x1876369722061056:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 51us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445805.605459:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 222 00010000:00010000:0.0:1789445805.792232:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445806.811385:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445807.194986:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742016768:0@lo:400:kworker.0 00000100:00100000:0.0:1789445807.195124:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445807.195186:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742017280:0@lo:400:kworker.0 00000100:00100000:0.0:1789445807.195230:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445807.195279:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789445807.195286:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742016896:0@lo:400:kworker.0 00000100:00100000:0.0:1789445807.195312:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445807.195353:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742016768 00000100:00100000:0.0:1789445807.195363:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742016768 00000100:00100000:0.0:1789445807.195429:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742016896 00000100:00100000:0.0:1789445807.195433:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742016896 00000100:00100000:0.0:1789445807.195473:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789445807.195483:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742016768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445807.195554:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742016768:12345-0@lo:400:kworker.0 Request processed in 61us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445807.195563:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789445807.195582:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789445807.195589:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742016896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445807.195619:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742016896:12345-0@lo:400:kworker.0 Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445807.195625:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789445807.195647:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742017280 00000100:00100000:0.0:1789445807.195651:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742017280 00000100:00100000:0.0:1789445807.195683:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789445807.195690:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742017280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445807.195722:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742017280:12345-0@lo:400:kworker.0 Request processed in 33us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445807.195729:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789445807.195763:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789445807.195769:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789445807.195819:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742016896:0@lo:400:kworker.0 00000100:00100000:0.0:1789445807.195832:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742016768:0@lo:400:kworker.0 00010000:00080000:0.0:1789445807.195847:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf50c000 x1876369742017280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445807.195857:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742017280:0@lo:400:kworker.0 00000100:00100000:2.0:1789445807.196216:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742017024:0@lo:400:kworker.0 00000100:00100000:2.0:1789445807.196258:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445807.196302:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789445807.196310:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742016640:0@lo:400:kworker.0 00000100:00100000:2.0:1789445807.196349:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445807.196373:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742017152:0@lo:400:kworker.0 00000100:00100000:2.0:1789445807.196404:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445807.196455:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742017024 00000100:00100000:2.0:1789445807.196460:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742017024 00000100:00100000:2.0:1789445807.196499:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789445807.196507:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742017024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445807.196698:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742017024:12345-0@lo:400:kworker.0 Request processed in 191us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445807.196706:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789445807.196733:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742016640 00000100:00100000:2.0:1789445807.196748:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742016640 00000100:00100000:2.0:1789445807.196774:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789445807.196780:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3312:x1876369742016640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445807.196811:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3312:x1876369742016640:12345-0@lo:400:kworker.0 Request processed in 31us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445807.196818:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789445807.196882:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742016640:0@lo:400:kworker.0 00010000:00080000:2.0:1789445807.196898:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf50f100 x1876369742017024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445807.196910:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742017024:0@lo:400:kworker.0 00000100:00080000:2.0:1789445807.196933:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789445807.196946:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742017152 00000100:00100000:2.0:1789445807.196949:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742017152 00000100:00100000:2.0:1789445807.196985:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789445807.196992:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742017152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445807.197030:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742017152:12345-0@lo:400:kworker.0 Request processed in 39us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445807.197037:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789445807.197230:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742017152:0@lo:400:kworker.0 00000100:00080000:2.0:1789445807.197249:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789445807.708804:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742017408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789445807.708901:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445807.709093:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742017408 00000100:00100000:3.0:1789445807.709105:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742017408 00000100:00100000:3.0:1789445807.709160:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789445807.709174:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742017408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789445807.709219:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789445807.709293:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742017408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445807.709301:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1789445807.709353:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeba655500 x1876369742017408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445807.709375:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742017408:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789445807.834726:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445808.859251:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445809.883580:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445810.267197:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789445810.269752:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742017536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789445810.269867:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445810.269951:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742017536 00000100:00100000:2.0:1789445810.269962:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742017536 00000100:00100000:2.0:1789445810.270075:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789445810.270088:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742017536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789445810.270135:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789445810.270175:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789445810.270206:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742017536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445810.270214:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1789445810.270250:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf50ea00 x1876369742017536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445810.270273:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742017536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789445810.723522:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445810.723576:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445810.723605:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445810.723627:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445810.723651:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445810.723675:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722061824 00000100:00100000:1.0:1789445810.723684:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722061824 00000100:00100000:1.0:1789445810.723755:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722061952 00000100:00100000:1.0:1789445810.723759:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722061952 00000100:00100000:1.0:1789445810.723780:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 72 00000100:00100000:1.0:1789445810.723800:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2376:x1876369722061824:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445810.723867:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2376:x1876369722061824:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 68us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445810.723886:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 72 00000100:00100000:1.0:1789445810.723902:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 73 00000100:00100000:1.0:1789445810.723908:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:338e572d-37d9-47c3-87b6-4735cd889844+5:2376:x1876369722061952:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445810.723931:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:338e572d-37d9-47c3-87b6-4735cd889844+5:2376:x1876369722061952:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 24us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445810.723937:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 73 00000100:00100000:1.0:1789445810.723952:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722062080 00000100:00100000:1.0:1789445810.723955:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722062080 00000100:00100000:1.0:1789445810.723979:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722062208 00000100:00100000:1.0:1789445810.723982:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722062208 00000100:00100000:1.0:1789445810.723996:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 42 00000100:00100000:1.0:1789445810.724003:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2376:x1876369722062080:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445810.724026:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2376:x1876369722062080:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 24us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445810.724032:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 42 00000100:00080000:0.0:1789445810.726195:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789445810.726203:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789445810.726207:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789445810.726233:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 43 00000100:00100000:0.0:1789445810.726251:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:338e572d-37d9-47c3-87b6-4735cd889844+5:2376:x1876369722062208:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445810.726317:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:338e572d-37d9-47c3-87b6-4735cd889844+5:2376:x1876369722062208:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 74us (2664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445810.726324:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 43 00000100:00100000:0.0:1789445810.726357:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722061696 00000100:00100000:0.0:1789445810.726363:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722061696 00000100:00100000:0.0:1789445810.726598:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 224 00000100:00100000:0.0:1789445810.726605:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2376:x1876369722061696:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445810.726633:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2376:x1876369722061696:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 29us (3028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445810.726655:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 224 00010000:00010000:1.0:1789445810.906315:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445811.931706:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445812.314354:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742017664:0@lo:400:kworker.0 00000100:00100000:2.0:1789445812.314368:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742017792:0@lo:400:kworker.0 00000100:00100000:1.0:1789445812.314440:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742018048:0@lo:400:kworker.0 00000100:00100000:2.0:1789445812.316073:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445812.316165:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742018304:0@lo:400:kworker.0 00000100:00100000:2.0:1789445812.316226:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445812.316269:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789445812.316277:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742017920:0@lo:400:kworker.0 00000100:00100000:2.0:1789445812.316301:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445812.316341:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742018304 00000100:00100000:2.0:1789445812.316352:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742018304 00000100:00100000:2.0:1789445812.316449:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789445812.316462:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742018304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445812.316469:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445812.316526:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742018304:12345-0@lo:400:kworker.0 Request processed in 68us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445812.316535:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789445812.316546:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742017792 00000100:00100000:0.0:1789445812.316550:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742017792 00000100:00100000:2.0:1789445812.316563:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742017920 00000100:00100000:2.0:1789445812.316566:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742017920 00000100:00100000:0.0:1789445812.316583:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789445812.316588:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789445812.316590:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742017792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445812.316593:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742017920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445812.316622:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742017920:12345-0@lo:400:kworker.0 Request processed in 28us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445812.316624:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742017792:12345-0@lo:400:kworker.0 Request processed in 35us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445812.316630:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789445812.316638:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1789445812.316651:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445812.316655:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742018176:0@lo:400:kworker.0 00000100:00100000:3.0:1789445812.316686:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789445812.316805:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789445812.316827:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742017664 00000100:00100000:2.0:1789445812.316831:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742017664 00000100:00100000:0.0:1789445812.316847:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742018176 00000100:00100000:0.0:1789445812.316851:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742018176 00000100:00100000:2.0:1789445812.316859:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789445812.316865:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742017664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445812.316875:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789445812.316880:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742018176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445812.316976:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445812.316982:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742017664:12345-0@lo:400:kworker.0 Request processed in 116us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445812.316990:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789445812.317015:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742018048 00000100:00100000:1.0:1789445812.317019:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742018048 00000100:00080000:2.0:1789445812.317032:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445812.317076:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742017920:0@lo:400:kworker.0 00000100:00100000:1.0:1789445812.317083:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789445812.317090:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742017792:0@lo:400:kworker.0 00000100:00100000:1.0:1789445812.317090:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742018048:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789445812.317103:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf50dc00 x1876369742018304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445812.317114:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742018304:0@lo:400:kworker.0 00000100:00100000:1.0:1789445812.317125:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742018048:12345-0@lo:400:kworker.0 Request processed in 37us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445812.317130:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789445812.317146:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789445812.317154:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf50c700 x1876369742018048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445812.317163:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742018048:0@lo:400:kworker.0 00000100:00100000:3.0:1789445812.317278:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742017664:0@lo:400:kworker.0 00000100:00100000:0.0:1789445812.317403:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742018176:12345-0@lo:400:kworker.0 Request processed in 521us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445812.317411:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789445812.317609:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742018176:0@lo:400:kworker.0 00000100:00100000:0.0:1789445812.826281:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742018432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789445812.826369:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445812.826497:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742018432 00000100:00100000:3.0:1789445812.826507:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742018432 00000100:00100000:3.0:1789445812.826567:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789445812.826579:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742018432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789445812.826626:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789445812.826694:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742018432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445812.826702:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1789445812.826764:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeba654e00 x1876369742018432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445812.826789:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742018432:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789445812.957546:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445813.980323:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445815.011187:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445815.402712:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742018560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789445815.402790:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445815.405784:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742018560 00000100:00100000:3.0:1789445815.405800:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742018560 00000100:00100000:3.0:1789445815.405878:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789445815.405889:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742018560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789445815.405924:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789445815.405998:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742018560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (3208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445815.406005:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1789445815.406072:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf617800 x1876369742018560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445815.406092:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742018560:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789445815.412303:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445815.847194:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445815.847234:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445815.847271:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445815.847301:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445815.847328:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445815.847355:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722062720 00000100:00100000:3.0:1789445815.847363:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722062720 00000100:00100000:3.0:1789445815.847429:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722062848 00000100:00100000:3.0:1789445815.847433:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722062848 00000100:00100000:3.0:1789445815.847452:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 14 00000100:00100000:3.0:1789445815.847461:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2373:x1876369722062720:12345-192.168.206.59@tcp:9:kworker.0 00000020:00000080:3.0:1789445815.847487:0:6685:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47256178 00000100:00080000:3.0:1789445815.847495:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9afeba7a6000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789445815.847653:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722062336 00000100:00100000:0.0:1789445815.847657:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722062336 00000100:00100000:0.0:1789445815.847683:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 226 00000100:00100000:0.0:1789445815.847691:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2376:x1876369722062336:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445815.847761:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2376:x1876369722062336:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 71us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445815.847768:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 226 00000100:00080000:0.0:1789445815.847830:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789445815.847834:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789445815.847860:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789445815.847981:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789445815.849480:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:338e572d-37d9-47c3-87b6-4735cd889844+2:2373:x1876369722062720:12345-192.168.206.59@tcp:9:kworker.0 Request processed in 2011us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445815.849637:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722062592 00000100:00100000:1.0:1789445815.849645:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722062592 00000100:00100000:1.0:1789445815.849720:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722062464 00000100:00100000:1.0:1789445815.849724:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722062464 00000100:00100000:1.0:1789445815.849751:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 77 00000100:00100000:1.0:1789445815.849761:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2376:x1876369722062592:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445815.849800:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2376:x1876369722062592:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 42us (2566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445815.849808:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 77 00000100:00100000:1.0:1789445815.849823:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 78 00000100:00100000:1.0:1789445815.849829:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2376:x1876369722062464:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445815.849852:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2376:x1876369722062464:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 23us (2580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445815.849858:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 78 00000100:00080000:0.0:1789445815.850588:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445815.850861:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 14 00000100:00100000:3.0:1789445815.850893:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 15 00000100:00100000:3.0:1789445815.850906:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2373:x1876369722062848:12345-192.168.206.59@tcp:9:kworker.0 00000020:00000080:3.0:1789445815.850936:0:6685:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d4725617f 00000100:00080000:3.0:1789445815.850948:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9afebfa49000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789445815.851806:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789445815.852199:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:338e572d-37d9-47c3-87b6-4735cd889844+2:2373:x1876369722062848:12345-192.168.206.59@tcp:9:kworker.0 Request processed in 1294us (4865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445815.852208:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 15 00010000:00010000:1.0:1789445815.854879:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789445816.008522:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 338e572d-37d9-47c3-87b6-4735cd889844 00000020:00000080:2.0:1789445816.008531:0:6708:0:(genops.c:885:class_export_put()) final put ffff9afeba7a4800/338e572d-37d9-47c3-87b6-4735cd889844 00000020:00000080:0.0:1789445816.009479:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afeba7a4800/338e572d-37d9-47c3-87b6-4735cd889844 for lustre-OST0000 00000020:00000080:0.0:1789445816.009559:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afeba7a6000 for lustre-OST0000 00010000:00010000:3.0:1789445816.026335:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445817.052685:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445817.437853:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742018816:0@lo:400:kworker.0 00000100:00100000:0.0:1789445817.437919:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445817.437975:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742019328:0@lo:400:kworker.0 00000100:00100000:0.0:1789445817.437999:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445817.438026:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789445817.438032:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742018944:0@lo:400:kworker.0 00000100:00100000:0.0:1789445817.438082:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445817.438115:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742018816 00000100:00100000:0.0:1789445817.438125:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742018816 00000100:00100000:0.0:1789445817.438166:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742018944 00000100:00100000:0.0:1789445817.438168:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742018944 00000100:00100000:0.0:1789445817.438199:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789445817.438221:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742018816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445817.438272:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742019072:0@lo:400:kworker.0 00000100:00100000:0.0:1789445817.438277:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742018816:12345-0@lo:400:kworker.0 Request processed in 71us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445817.438284:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789445817.438302:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445817.438330:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789445817.438336:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742018688:0@lo:400:kworker.0 00000100:00100000:2.0:1789445817.438360:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445817.438381:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742019200:0@lo:400:kworker.0 00000100:00100000:2.0:1789445817.438400:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445817.438420:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742018688 00000100:00100000:2.0:1789445817.438424:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742018688 00000100:00100000:2.0:1789445817.438454:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789445817.438460:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3312:x1876369742018688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445817.438495:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3312:x1876369742018688:12345-0@lo:400:kworker.0 Request processed in 35us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445817.438501:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789445817.438555:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742018688:0@lo:400:kworker.0 00000100:00100000:0.0:1789445817.438621:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742019200 00000100:00100000:0.0:1789445817.438625:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742019200 00000100:00100000:0.0:1789445817.438641:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789445817.438646:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742018944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445817.438675:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742018944:12345-0@lo:400:kworker.0 Request processed in 29us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445817.438701:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789445817.438713:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789445817.438719:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742019200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445817.438758:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742019200:12345-0@lo:400:kworker.0 Request processed in 39us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445817.438773:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789445817.438791:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742019328 00000100:00100000:0.0:1789445817.438794:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742019328 00000100:00100000:0.0:1789445817.438820:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742019072 00000100:00100000:0.0:1789445817.438823:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742019072 00000100:00100000:0.0:1789445817.438836:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789445817.438842:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742019328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445817.438869:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742019328:12345-0@lo:400:kworker.0 Request processed in 28us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445817.438875:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789445817.438884:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789445817.438889:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742019072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445817.438911:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742019072:12345-0@lo:400:kworker.0 Request processed in 22us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445817.438916:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1789445817.438935:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789445817.438939:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789445817.438942:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789445817.438963:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742018944:0@lo:400:kworker.0 00000100:00100000:0.0:1789445817.438973:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742018816:0@lo:400:kworker.0 00010000:00080000:0.0:1789445817.438983:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeadb9aa00 x1876369742019328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445817.439000:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742019328:0@lo:400:kworker.0 00000100:00100000:2.0:1789445817.439267:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742019200:0@lo:400:kworker.0 00010000:00080000:2.0:1789445817.439279:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4fdc380 x1876369742019072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445817.439287:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742019072:0@lo:400:kworker.0 00000001:02000400:1.0:1789445817.439934:0:11010:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1789445817.947743:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789445817.947767:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742019456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789445817.947848:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445817.948087:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742019456 00000100:00100000:3.0:1789445817.948098:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742019456 00000100:00100000:3.0:1789445817.948167:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789445817.948178:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742019456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789445817.948244:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789445817.948510:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742019456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 333us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445817.948519:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1789445817.948668:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeba657b80 x1876369742019456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445817.948697:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742019456:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789445818.074335:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789445818.540461:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 338e572d-37d9-47c3-87b6-4735cd889844 00000020:00000080:0.0:1789445818.540472:0:7638:0:(genops.c:885:class_export_put()) final put ffff9afebfa4d800/338e572d-37d9-47c3-87b6-4735cd889844 00000020:00000080:2.0:1789445818.540998:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afebfa4d800/338e572d-37d9-47c3-87b6-4735cd889844 for lustre-OST0001 00000020:00000080:2.0:1789445818.541168:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afebfa49000 for lustre-OST0001 00010000:00010000:0.0:1789445819.101965:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445820.123651:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445820.507373:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789445820.507395:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742019584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789445820.507469:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445820.507635:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742019584 00000100:00100000:2.0:1789445820.507643:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742019584 00000100:00100000:2.0:1789445820.507711:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789445820.507721:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742019584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789445820.507756:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789445820.507803:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742019584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445820.507809:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1789445820.507867:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789445820.507897:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf616a00 x1876369742019584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445820.507915:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742019584:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1789445820.794685:0:11158:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdfb21b9c0 20000000:00000080:0.0:1789445820.794705:0:11158:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9afebffb0c00 uarg=0000000000000000 20000000:01000000:0.0:1789445820.794743:0:11158:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789445820.794749:0:11158:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789445820.794754:0:11158:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789445820.795839:0:11159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789445820.796019:0:11158:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789445820.816859:0:11158:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789445820.820616:0:11158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afe91b6e400/0xc1b37c4d47256186 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445820.820642:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe81678a00/0xc1b37c4d4725612b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a6c expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445820.820651:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afeb57bf000/0xc1b37c4d47256139 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47256132 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445820.820658:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47256147 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47256140 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445820.820664:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe813fc600/0xc1b37c4d47256155 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d4725614e expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445820.820679:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe81678400/0xc1b37c4d4725616a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4aa4 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445820.820687:0:11158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afe91b6e400/0xc1b37c4d47256186 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445820.820729:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe81678400/0xc1b37c4d4725616a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4aa4 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445820.820761:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afe81678400/0xc1b37c4d4725616a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4aa4 expref: 12 pid: 5835 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445820.820775:0:11158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1876369742019712:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789445820.820923:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe813fc600/0xc1b37c4d47256155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d4725614e expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445820.820931:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe813fc600/0xc1b37c4d47256155 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d4725614e expref: 18 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445820.820940:0:11158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1876369742019840:0@lo:104: 00000100:00100000:1.0:1789445820.820977:0:11158:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789445820.821021:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47256147 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47256140 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445820.821029:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47256147 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47256140 expref: 18 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445820.821038:0:11158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1876369742019968:0@lo:104: 00000100:00100000:1.0:1789445820.821079:0:11158:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789445820.821102:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afeb57bf000/0xc1b37c4d47256139 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47256132 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445820.821110:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afeb57bf000/0xc1b37c4d47256139 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47256132 expref: 18 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445820.821117:0:11158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d41f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1876369742020096:0@lo:104: 00000100:00100000:1.0:1789445820.821135:0:11158:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789445820.825726:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe81678a00/0xc1b37c4d4725612b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a6c expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445820.825746:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afe81678a00/0xc1b37c4d4725612b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a6c expref: 12 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445820.825761:0:11158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1876369742020224:192.168.206.59@tcp:104: 00000100:00100000:1.0:1789445820.825823:0:11158:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4d079c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445820.826070:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742019840 00000100:00100000:0.0:1789445820.826078:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742019840 00000100:00100000:0.0:1789445820.826112:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742019968 00000100:00100000:0.0:1789445820.826114:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742019968 00000100:00100000:0.0:1789445820.826122:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742020096 00000100:00100000:0.0:1789445820.826125:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742020096 00000100:00100000:0.0:1789445820.826137:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789445820.826144:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:11158:x1876369742019840:12345-0@lo:104: 00010000:00010000:0.0:1789445820.826169:0:7626:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afeb57be400/0xc1b37c4d4725614e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47256155 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826227:0:7626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789445820.826233:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:11158:x1876369742019840:12345-0@lo:104: Request processed in 89us (5256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445820.826240:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789445820.826255:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789445820.826261:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+4:11158:x1876369742019968:12345-0@lo:104: 00010000:00010000:0.0:1789445820.826267:0:7626:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfc00/0xc1b37c4d47256140 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47256147 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826297:0:7626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789445820.826302:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+4:11158:x1876369742019968:12345-0@lo:104: Request processed in 42us (5223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445820.826307:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789445820.826318:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789445820.826323:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:11158:x1876369742020096:12345-0@lo:104: 00010000:00010000:0.0:1789445820.826331:0:7626:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d47256132 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47256139 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826364:0:7626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789445820.826369:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:11158:x1876369742020096:12345-0@lo:104: Request processed in 46us (5233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445820.826374:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1789445820.826389:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789445820.826395:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afeb57be400/0xc1b37c4d4725614e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47256155 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826408:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be400 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1789445820.826412:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57be400/0xc1b37c4d4725614e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47256155 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826420:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afeb57be400/0xc1b37c4d4725614e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47256155 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789445820.826427:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57be400/0xc1b37c4d4725614e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47256155 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445820.826433:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789445820.826461:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afeb57be400/0xc1b37c4d4725614e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47256155 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826468:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789445820.826567:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afeb57be400/0xc1b37c4d4725614e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47256155 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826575:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afeb57be400/0xc1b37c4d4725614e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47256155 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826588:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789445820.826591:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfc00/0xc1b37c4d47256140 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47256147 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826596:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bfc00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1789445820.826600:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfc00/0xc1b37c4d47256140 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47256147 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826618:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfc00/0xc1b37c4d47256140 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47256147 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789445820.826624:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfc00/0xc1b37c4d47256140 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47256147 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445820.826628:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789445820.826642:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfc00/0xc1b37c4d47256140 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47256147 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826647:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789445820.826661:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfc00/0xc1b37c4d47256140 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47256147 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826667:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfc00/0xc1b37c4d47256140 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47256147 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826687:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445820.826690:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d47256132 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47256139 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826694:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988000 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1789445820.826696:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d47256132 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47256139 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826702:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d47256132 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47256139 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789445820.826708:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d47256132 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47256139 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445820.826719:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789445820.826733:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d47256132 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47256139 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826739:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789445820.826745:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d47256132 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47256139 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826751:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d47256132 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47256139 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.826765:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445820.826766:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445820.826768:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445820.826774:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445820.826779:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445820.826794:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742020352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789445820.826828:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445820.826861:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369742020480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789445820.827083:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445820.827101:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789445820.827107:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369742020608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789445820.827127:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445820.827153:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742020352 00000100:00100000:0.0:1789445820.827158:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742020352 00010000:00010000:0.0:1789445820.827177:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe813fc600/0xc1b37c4d47256155 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d4725614e expref: 19 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445820.827207:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742020480 00000100:00100000:0.0:1789445820.827210:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742020480 00010000:00010000:0.0:1789445820.827221:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47256147 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47256140 expref: 20 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445820.827230:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742020608 00000100:00100000:0.0:1789445820.827231:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742020608 00010000:00010000:0.0:1789445820.827239:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afeb57bf000/0xc1b37c4d47256139 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47256132 expref: 21 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445820.827250:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789445820.827256:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe919b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+21:3313:x1876369742020352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789445820.827267:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445820.827272:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe813fc600/0xc1b37c4d47256155 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d4725614e expref: 21 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.827281:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe813fc600/0xc1b37c4d47256155 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d4725614e expref: 21 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.827295:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445820.827323:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe919b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+21:3313:x1876369742020352:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445820.827330:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789445820.827366:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789445820.827372:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+20:3310:x1876369742020480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789445820.827378:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445820.827382:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47256147 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47256140 expref: 20 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.827399:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47256147 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47256140 expref: 20 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.827408:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445820.827434:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+20:3310:x1876369742020480:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445820.827440:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789445820.827453:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789445820.827458:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3310:x1876369742020608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789445820.827465:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445820.827469:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afeb57bf000/0xc1b37c4d47256139 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47256132 expref: 19 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.827476:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afeb57bf000/0xc1b37c4d47256139 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47256132 expref: 19 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445820.828694:0:11158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe813fc600/0xc1b37c4d47256155 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d4725614e expref: 19 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445820.828712:0:11158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1876369742019840:0@lo:104: 00010000:00010000:1.0:1789445820.828724:0:11158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe813fc000/0xc1b37c4d47256147 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47256140 expref: 18 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445820.828733:0:11158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1876369742019968:0@lo:104: 00000100:00100000:1.0:1789445820.828741:0:11158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d41f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1876369742020096:0@lo:104: 00010000:00010000:0.0:1789445820.829016:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afeb57bf000/0xc1b37c4d47256139 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47256132 expref: 17 pid: 5836 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445820.829027:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445820.829092:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:3310:x1876369742020608:12345-0@lo:103:ldlm_bl.0 Request processed in 1634us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445820.829100:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789445820.829147:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742020352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789445820.829177:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369742020608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789445820.829185:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369742020480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789445820.832251:0:11158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1876369742019712:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445820.832265:0:11158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1876369742020224:192.168.206.59@tcp:104: 00010000:00010000:2.0:1789445820.832296:0:11158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afe91b6e400/0xc1b37c4d47256186 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445820.833505:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445820.833594:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445820.833669:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722062976 00000100:00100000:2.0:1789445820.833688:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722062976 00010000:00010000:2.0:1789445820.833723:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe81678400/0xc1b37c4d4725616a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4aa4 expref: 13 pid: 5835 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445820.833758:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722063104 00000100:00100000:2.0:1789445820.833770:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722063104 00010000:00010000:2.0:1789445820.833785:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe81678a00/0xc1b37c4d4725612b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a6c expref: 14 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445820.833815:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 28 00000100:00100000:2.0:1789445820.833824:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+14:2375:x1876369722062976:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445820.833839:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445820.833844:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe81678400/0xc1b37c4d4725616a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4aa4 expref: 14 pid: 5835 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445820.833856:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe81678400/0xc1b37c4d4725616a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4aa4 expref: 14 pid: 5835 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445820.833887:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81678400/0xc1b37c4d4725616a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4aa4 expref: 14 pid: 5835 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445820.833902:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445820.833951:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2375:x1876369722062976:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 127us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445820.833959:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 28 00000100:00100000:2.0:1789445820.833977:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 29 00000100:00100000:2.0:1789445820.833983:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:2375:x1876369722063104:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445820.833991:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445820.833996:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe81678a00/0xc1b37c4d4725612b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a6c expref: 12 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445820.834005:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe81678a00/0xc1b37c4d4725612b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a6c expref: 12 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445820.834027:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81678a00/0xc1b37c4d4725612b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a6c expref: 12 pid: 5834 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445820.834038:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afe91b6e400/0xc1b37c4d47256186 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445820.834078:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe91b6e400/0xc1b37c4d47256186 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445820.834095:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afe91b6e400/0xc1b37c4d47256186 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445820.834102:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afe91b6e400/0xc1b37c4d47256186 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445820.834110:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afe91b6e400/0xc1b37c4d47256186 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445820.834116:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afe91b6e400/0xc1b37c4d47256186 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445820.834122:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445820.834126:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afe91b6e400/0xc1b37c4d47256186 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445820.834134:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afe91b6e400/0xc1b37c4d47256186 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445820.834149:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afe91b6e400/0xc1b37c4d47256186 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445820.834170:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445820.834191:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+11:2375:x1876369722063104:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 208us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445820.834198:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 29 00010000:00010000:2.0:1789445820.834224:0:11158:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afe91b6e400/0xc1b37c4d47256186 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445820.834234:0:11158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afe91b6e400/0xc1b37c4d47256186 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445820.834240:0:11158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe91b6e400/0xc1b37c4d47256186 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445820.964701:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445820.964756:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445820.967493:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722063232 00000100:00100000:0.0:1789445820.967513:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722063232 00000100:00100000:0.0:1789445820.968038:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722063360 00000100:00100000:0.0:1789445820.968078:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722063360 00000100:00080000:1.0:1789445820.968137:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445820.968139:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 82 00000100:00100000:3.0:1789445820.968167:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2375:x1876369722063232:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445820.968305:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2375:x1876369722063232:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 151us (3619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445820.968313:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 82 00000100:00100000:0.0:1789445820.975879:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 83 00000100:00100000:0.0:1789445820.975903:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2375:x1876369722063360:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445820.975992:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2375:x1876369722063360:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 101us (11235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445820.976001:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 83 00010000:00010000:0.0:1789445821.146763:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445822.170546:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445822.437479:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445822.437616:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722063488 00000100:00100000:2.0:1789445822.437630:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722063488 00000100:00100000:2.0:1789445822.437709:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 228 00000100:00100000:2.0:1789445822.437722:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+11:5631:x1876369722063488:12345-192.168.206.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789445822.437742:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445822.437766:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afeb57be000/0xc1b37c4d4725618d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ace expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445822.437803:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afeb57be000/0xc1b37c4d4725618d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ace expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445822.437816:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afeb57be000/0xc1b37c4d4725618d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ace expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445822.437828:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57be000, rc 0) 00000100:00100000:2.0:1789445822.437910:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:5631:x1876369722063488:12345-192.168.206.59@tcp:101:ll_cfg_requeue.0 Request processed in 191us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445822.437919:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 228 00000100:00100000:3.0:1789445822.445525:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445822.445648:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722063616 00000100:00100000:0.0:1789445822.445672:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722063616 00000100:00100000:0.0:1789445822.445738:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 229 00000100:00100000:0.0:1789445822.445752:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:5631:x1876369722063616:12345-192.168.206.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789445822.446141:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:5631:x1876369722063616:12345-192.168.206.59@tcp:501:ll_cfg_requeue.0 Request processed in 389us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445822.446151:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 229 00000100:00100000:3.0:1789445822.448289:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445822.448745:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722063744 00000100:00100000:0.0:1789445822.448758:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722063744 00000100:00100000:0.0:1789445822.448828:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 230 00000100:00100000:0.0:1789445822.448840:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:5631:x1876369722063744:12345-192.168.206.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789445822.449301:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:5631:x1876369722063744:12345-192.168.206.59@tcp:503:ll_cfg_requeue.0 Request processed in 460us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445822.449321:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 230 00000100:00100000:0.0:1789445822.462895:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445822.462978:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722063872 00000100:00100000:3.0:1789445822.462992:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722063872 00000100:00100000:3.0:1789445822.463088:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 231 00000100:00100000:3.0:1789445822.463101:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:5631:x1876369722063872:12345-192.168.206.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789445822.463122:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445822.463147:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256194 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ad5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445822.463185:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ad5 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445822.463197:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ad5 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445822.463208:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fde00, rc 0) 00000100:00100000:3.0:1789445822.463286:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:5631:x1876369722063872:12345-192.168.206.59@tcp:101:ll_cfg_requeue.0 Request processed in 188us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445822.463294:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 231 00000100:00100000:3.0:1789445822.467835:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445822.467910:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722064000 00000100:00100000:0.0:1789445822.467922:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722064000 00000100:00100000:0.0:1789445822.467987:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 232 00000100:00100000:0.0:1789445822.467998:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:5631:x1876369722064000:12345-192.168.206.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789445822.468399:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:5631:x1876369722064000:12345-192.168.206.59@tcp:501:ll_cfg_requeue.0 Request processed in 400us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445822.468409:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 232 00000100:00100000:1.0:1789445822.476772:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445822.477023:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722064128 00000100:00100000:3.0:1789445822.477036:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722064128 00000100:00100000:3.0:1789445822.477442:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 233 00000100:00100000:3.0:1789445822.477454:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:5631:x1876369722064128:12345-192.168.206.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789445822.479460:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:5631:x1876369722064128:12345-192.168.206.59@tcp:503:ll_cfg_requeue.0 Request processed in 1994us (2687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445822.479476:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 233 00000100:00100000:0.0:1789445822.559298:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742020736:0@lo:400:kworker.0 00000100:00100000:0.0:1789445822.559393:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445822.559589:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742021248:0@lo:400:kworker.0 00000100:00100000:0.0:1789445822.559624:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445822.559659:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789445822.559679:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742020864:0@lo:400:kworker.0 00000100:00100000:0.0:1789445822.559703:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445822.559720:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742021376:0@lo:400:kworker.0 00000100:00100000:0.0:1789445822.559744:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445822.559780:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742020992:0@lo:400:kworker.0 00000100:00100000:0.0:1789445822.559804:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445822.559822:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789445822.559829:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742021120:0@lo:400:kworker.0 00000100:00100000:0.0:1789445822.559848:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445822.559884:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742021248 00000100:00100000:0.0:1789445822.559903:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742021248 00000100:00100000:0.0:1789445822.559967:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742020864 00000100:00100000:0.0:1789445822.559970:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742020864 00000100:00100000:0.0:1789445822.559984:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742020992 00000100:00100000:0.0:1789445822.559986:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742020992 00000100:00100000:0.0:1789445822.560003:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789445822.560013:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742021248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445822.560103:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742021248:12345-0@lo:400:kworker.0 Request processed in 91us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445822.560110:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789445822.560130:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789445822.560135:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742020864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445822.560162:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742020864:12345-0@lo:400:kworker.0 Request processed in 27us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445822.560168:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789445822.560179:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789445822.560185:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742020992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445822.560214:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742020992:12345-0@lo:400:kworker.0 Request processed in 29us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445822.560219:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789445822.560237:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742021376 00000100:00100000:0.0:1789445822.560241:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742021376 00000100:00100000:0.0:1789445822.560264:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742021120 00000100:00100000:0.0:1789445822.560266:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742021120 00000100:00100000:0.0:1789445822.560281:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789445822.560287:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742021376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445822.560320:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742021376:12345-0@lo:400:kworker.0 Request processed in 33us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445822.560334:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789445822.560346:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789445822.560351:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742021120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445822.560381:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742021120:12345-0@lo:400:kworker.0 Request processed in 29us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445822.560387:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1789445822.560408:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789445822.560412:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789445822.560415:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445822.560795:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742020736 00000100:00100000:3.0:1789445822.560801:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742020736 00000100:00100000:3.0:1789445822.560835:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789445822.560843:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:3312:x1876369742020736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445822.560909:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742020864:0@lo:400:kworker.0 00000100:00100000:3.0:1789445822.565034:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:3312:x1876369742020736:12345-0@lo:400:kworker.0 Request processed in 4176us (5625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445822.565080:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00010000:00080000:1.0:1789445822.567873:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb575e680 x1876369742021120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445822.567897:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742021120:0@lo:400:kworker.0 00000100:00100000:1.0:1789445822.567913:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742020992:0@lo:400:kworker.0 00010000:00080000:0.0:1789445822.569803:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb575dc00 x1876369742021376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445822.569839:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742021376:0@lo:400:kworker.0 00000100:00100000:0.0:1789445822.569857:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742020736:0@lo:400:kworker.0 00000100:00100000:0.0:1789445822.569872:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742021248:0@lo:400:kworker.0 10000000:01000000:0.0:1789445822.618170:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789445822.618181:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afebb4dd000 from 7 10000000:01000000:0.0:1789445822.618188:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789445822.618266:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d4725619b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445822.618281:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d4725619b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445822.618295:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d4725619b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445822.618344:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742021504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789445822.618461:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445822.618597:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb56f5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789445822.618714:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742021504 00000100:00100000:3.0:1789445822.618727:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742021504 00000100:00100000:3.0:1789445822.618809:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789445822.618822:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369742021504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789445822.618842:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445822.618863:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe813fda00/0xc1b37c4d472561a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d4725619b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445822.618911:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe813fda00/0xc1b37c4d472561a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d4725619b expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445822.618925:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe813fda00/0xc1b37c4d472561a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d4725619b expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445822.618937:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fda00, rc 0) 00000100:00100000:3.0:1789445822.619011:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742021504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445822.619019:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789445822.619258:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742021504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789445822.619286:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d4725619b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472561a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445822.619297:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d4725619b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472561a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445822.619365:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742021632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789445822.619396:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445822.619429:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4d073c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445822.619544:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742021632 00000100:00100000:0.0:1789445822.619549:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742021632 00000100:00100000:0.0:1789445822.619581:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789445822.619588:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742021632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789445822.620614:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742021632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1017us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445822.620627:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789445822.624161:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742021632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789445822.624256:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742021760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789445822.624348:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445822.624652:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4d073c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445822.624726:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742021760 00000100:00100000:3.0:1789445822.624735:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742021760 00000100:00100000:3.0:1789445822.624839:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789445822.624850:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742021760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789445822.625276:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742021760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 426us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445822.625287:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789445822.625398:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742021760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789445822.626223:0:11214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789445822.626298:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789445822.626323:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789445822.626337:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d4725619b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472561a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445822.626351:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d4725619b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472561a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445822.626364:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789445822.626367:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afe8533d800 from 7 10000000:01000000:0.0:1789445822.626371:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789445822.626416:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e989400/0xc1b37c4d472561a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445822.626426:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe8e989400/0xc1b37c4d472561a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445822.626445:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe8e989400/0xc1b37c4d472561a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445822.626471:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742021888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789445822.626540:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445822.626959:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb56f5480 going to sleep for 11 seconds 00000100:00100000:1.0:1789445822.627088:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742021888 00000100:00100000:1.0:1789445822.627097:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742021888 00000100:00100000:1.0:1789445822.627143:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789445822.627153:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742021888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789445822.627169:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445822.627185:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe91b6e800/0xc1b37c4d472561b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472561a9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445822.627214:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe91b6e800/0xc1b37c4d472561b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472561a9 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445822.627226:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe91b6e800/0xc1b37c4d472561b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472561a9 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445822.627249:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6e800, rc 0) 00000100:00100000:1.0:1789445822.627303:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742021888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445822.627310:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789445822.627376:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742021888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789445822.627396:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe8e989400/0xc1b37c4d472561a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472561b0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445822.627407:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe8e989400/0xc1b37c4d472561a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472561b0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445822.627694:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742022016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789445822.627732:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445822.627754:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4d07480 going to sleep for 11 seconds 00000100:00100000:3.0:1789445822.627820:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742022016 00000100:00100000:3.0:1789445822.627825:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742022016 00000100:00100000:3.0:1789445822.627852:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789445822.627859:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742022016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789445822.628219:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742022016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 360us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445822.628228:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789445822.628438:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742022016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789445822.628596:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742022144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789445822.628644:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445822.628679:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4d07480 going to sleep for 11 seconds 00000100:00100000:1.0:1789445822.628695:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742022144 00000100:00100000:1.0:1789445822.628700:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742022144 00000100:00100000:1.0:1789445822.628723:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789445822.628730:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742022144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789445822.628975:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742022144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445822.628992:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789445822.629115:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742022144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789445822.630562:0:11215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789445822.630758:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789445822.630783:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789445822.630796:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e989400/0xc1b37c4d472561a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472561b0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445822.630810:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe8e989400/0xc1b37c4d472561a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472561b0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445822.630823:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789445822.630827:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afe9d560800 from 7 10000000:01000000:0.0:1789445822.630829:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789445822.630948:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e989000/0xc1b37c4d472561b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445822.630958:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe8e989000/0xc1b37c4d472561b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445822.630970:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe8e989000/0xc1b37c4d472561b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445822.630996:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742022272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789445822.631223:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445822.631311:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb56f5180 going to sleep for 11 seconds 00000100:00100000:1.0:1789445822.631346:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742022272 00000100:00100000:1.0:1789445822.631354:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742022272 00000100:00100000:1.0:1789445822.631448:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789445822.631460:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742022272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789445822.631482:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445822.631497:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe91b6e000/0xc1b37c4d472561be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472561b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445822.631524:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe91b6e000/0xc1b37c4d472561be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472561b7 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445822.631535:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe91b6e000/0xc1b37c4d472561be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472561b7 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445822.631544:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6e000, rc 0) 00000100:00100000:1.0:1789445822.631594:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742022272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445822.631601:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789445822.631684:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742022272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789445822.631700:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe8e989000/0xc1b37c4d472561b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472561be expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445822.631711:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe8e989000/0xc1b37c4d472561b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472561be expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445822.631773:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742022400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789445822.631801:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445822.632066:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb56f5180 going to sleep for 11 seconds 00000100:00100000:3.0:1789445822.632163:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742022400 00000100:00100000:3.0:1789445822.632169:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742022400 00000100:00100000:3.0:1789445822.632194:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789445822.632201:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742022400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789445822.632599:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742022400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 398us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445822.632608:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789445822.632817:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742022400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789445822.632863:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742022528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789445822.632974:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445822.633198:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb56f5180 going to sleep for 11 seconds 00000100:00100000:3.0:1789445822.633232:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742022528 00000100:00100000:3.0:1789445822.633238:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742022528 00000100:00100000:3.0:1789445822.633302:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789445822.633310:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742022528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789445822.633632:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742022528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 322us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445822.633640:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789445822.633725:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742022528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789445822.634841:0:11216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789445822.635328:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789445822.635353:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789445822.635365:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e989000/0xc1b37c4d472561b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472561be expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445822.635379:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe8e989000/0xc1b37c4d472561b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472561be expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445823.073434:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742022656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789445823.073510:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445823.073624:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742022656 00000100:00100000:0.0:1789445823.073632:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742022656 00000100:00100000:0.0:1789445823.073692:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789445823.073704:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742022656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789445823.073741:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789445823.073782:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742022656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445823.073789:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1789445823.073827:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf615180 x1876369742022656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445823.073846:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742022656:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789445823.197657:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445824.220337:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445825.246168:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789445825.565179:0:11355:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg659-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789445825.626341:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742022784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789445825.626415:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445825.626845:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742022784 00000100:00100000:0.0:1789445825.626855:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742022784 00000100:00100000:0.0:1789445825.626930:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789445825.626941:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742022784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789445825.626979:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789445825.627040:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742022784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445825.627073:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1789445825.627128:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf617100 x1876369742022784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445825.627152:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742022784:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789445825.627678:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789445826.094469:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445826.094506:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445826.094784:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445826.094910:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722064256 00000100:00100000:0.0:1789445826.094928:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722064256 00000100:00100000:0.0:1789445826.095304:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 244 00000100:00100000:0.0:1789445826.095317:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2375:x1876369722064256:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445826.095319:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722064512 00000100:00100000:3.0:1789445826.095335:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722064512 00000100:00080000:2.0:1789445826.095972:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445826.096179:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722064384 00000100:00100000:3.0:1789445826.096185:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722064384 00000100:00100000:3.0:1789445826.096224:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 87 00000100:00100000:3.0:1789445826.096235:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:338e572d-37d9-47c3-87b6-4735cd889844+5:2375:x1876369722064512:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445826.096316:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:338e572d-37d9-47c3-87b6-4735cd889844+5:2375:x1876369722064512:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 83us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445826.096324:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 87 00000100:00100000:3.0:1789445826.096340:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 88 00000100:00100000:3.0:1789445826.096346:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2375:x1876369722064384:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445826.096369:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2375:x1876369722064384:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 23us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445826.096375:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 88 00000100:00080000:2.0:1789445826.096599:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445826.097370:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2375:x1876369722064256:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 2052us (2908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445826.097382:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 244 00010000:00010000:0.0:1789445826.267587:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445827.290283:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445827.676532:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742022912:0@lo:400:kworker.0 00000100:00100000:2.0:1789445827.676659:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445827.676729:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742023424:0@lo:400:kworker.0 00000100:00100000:2.0:1789445827.676760:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445827.676796:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789445827.676802:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742023040:0@lo:400:kworker.0 00000100:00100000:2.0:1789445827.676825:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445827.676850:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742023552:0@lo:400:kworker.0 00000100:00100000:2.0:1789445827.676882:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445827.676925:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742023552 00000100:00100000:3.0:1789445827.676943:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742023552 00000100:00100000:2.0:1789445827.676951:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742023424 00000100:00100000:2.0:1789445827.676969:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742023424 00000100:00100000:2.0:1789445827.677034:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742023040 00000100:00100000:3.0:1789445827.677038:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789445827.677041:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742023040 00000100:00100000:3.0:1789445827.677138:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742023552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445827.677181:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789445827.677193:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742023424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445827.677257:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742023168:0@lo:400:kworker.0 00000100:00100000:1.0:1789445827.677367:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742022912 00000100:00100000:1.0:1789445827.677371:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742022912 00000100:00100000:2.0:1789445827.677611:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742023424:12345-0@lo:400:kworker.0 Request processed in 421us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445827.677620:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789445827.677651:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789445827.677658:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742023040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445827.677686:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742023040:12345-0@lo:400:kworker.0 Request processed in 30us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445827.677692:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1789445827.677718:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789445827.677724:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789445827.677766:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742023040:0@lo:400:kworker.0 00010000:00080000:2.0:1789445827.677781:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb575dc00 x1876369742023552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445827.677793:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742023552:0@lo:400:kworker.0 00000100:00100000:2.0:1789445827.677803:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742023424:0@lo:400:kworker.0 00000100:00100000:1.0:1789445827.678403:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789445827.678431:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3312:x1876369742022912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445827.678501:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3312:x1876369742022912:12345-0@lo:400:kworker.0 Request processed in 66us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445827.678522:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789445827.678811:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742022912:0@lo:400:kworker.0 00000100:00100000:3.0:1789445827.679976:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742023552:12345-0@lo:400:kworker.0 Request processed in 2838us (3085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445827.679989:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789445827.680831:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742023296:0@lo:400:kworker.0 00000100:00100000:1.0:1789445827.680932:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445827.681424:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742023296 00000100:00100000:2.0:1789445827.681436:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742023296 00000100:00100000:2.0:1789445827.681522:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789445827.681545:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742023296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445827.681633:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742023296:12345-0@lo:400:kworker.0 Request processed in 91us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445827.681651:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1789445827.681714:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb575d880 x1876369742023296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445827.681731:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742023296:0@lo:400:kworker.0 00000100:00100000:0.0:1789445827.681923:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445827.681987:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742023168 00000100:00100000:0.0:1789445827.681992:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742023168 00000100:00100000:0.0:1789445827.682031:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789445827.682039:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742023168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445827.682110:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742023168:12345-0@lo:400:kworker.0 Request processed in 71us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445827.682117:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789445827.682155:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742023168:0@lo:400:kworker.0 00000100:00080000:1.0:1789445827.683205:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789445827.683217:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789445828.192689:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789445828.192729:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742023680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789445828.193064:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445828.193152:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742023680 00000100:00100000:2.0:1789445828.193163:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742023680 00000100:00100000:2.0:1789445828.193227:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789445828.193239:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742023680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789445828.193289:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789445828.193339:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742023680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445828.193347:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789445828.193394:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf617480 x1876369742023680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445828.193563:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742023680:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789445828.315483:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445829.342165:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789445829.764953:0:11456:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 00:17:07 (1789445827) === 00000100:00100000:3.0:1789445829.937872:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445829.937968:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445829.940161:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722064640 00000100:00100000:1.0:1789445829.940175:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722064640 00000100:00100000:1.0:1789445829.940245:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 14 00000100:00100000:1.0:1789445829.940258:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2377:x1876369722064640:12345-192.168.206.59@tcp:41:mkdir.0 00000004:00000024:1.0:1789445829.940913:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789445829.941014:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2377:x1876369722064640:12345-192.168.206.59@tcp:41:mkdir.0 Request processed in 758us (3148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445829.941021:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 14 00000100:00080000:1.0:1789445829.941070:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789445829.942111:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722064768 00000100:00100000:0.0:1789445829.942123:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722064768 00000100:00100000:0.0:1789445829.942173:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 0 00000100:00100000:0.0:1789445829.942185:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:9724:x1876369722064768:12345-192.168.206.59@tcp:700:mkdir.0 00000100:00100000:0.0:1789445829.942259:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:9724:x1876369722064768:12345-192.168.206.59@tcp:700:mkdir.0 Request processed in 76us (4291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445829.942267:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 0 00000100:00100000:2.0:1789445829.945298:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445829.945433:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722065024 00000100:00100000:1.0:1789445829.945443:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722065024 00000100:00100000:1.0:1789445829.945518:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 15 00000100:00100000:1.0:1789445829.945531:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:9724:x1876369722065024:12345-192.168.206.59@tcp:36:mkdir.0 00010000:00010000:1.0:1789445829.945583:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445829.947100:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe81505000/0xc1b37c4d472560a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a57 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.947131:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe90eac600) 00010000:00010000:1.0:1789445829.947149:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789445829.947571:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d472561c5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.947598:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d472561c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.947610:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d472561c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.947625:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f000/0xc1b37c4d472561cc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.947643:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f000/0xc1b37c4d472561cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.947650:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f000/0xc1b37c4d472561cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445829.949028:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789445829.949070:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d472561c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.949081:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d472561c5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.949089:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d472561c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.949095:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6fc00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445829.949101:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d472561c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.949109:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d472561c5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.949136:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe858f5600) 00010000:00010000:1.0:1789445829.949139:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445829.949145:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d472561c5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.949151:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d472561c5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789445829.949172:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba8f4beb reply state 000000002d72eb49 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f000/0xc1b37c4d472561cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445829.949181:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789445829.949305:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:9724:x1876369722065024:12345-192.168.206.59@tcp:36:mkdir.0 Request processed in 3773us (4024us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789445829.949316:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 15 00010000:00010000:1.0:1789445829.957921:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f000/0xc1b37c4d472561cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.957944:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f000/0xc1b37c4d472561cc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.957952:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f000/0xc1b37c4d472561cc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.957959:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6f000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445829.957965:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f000/0xc1b37c4d472561cc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.957974:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f000/0xc1b37c4d472561cc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.961492:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9afe858f5f00) 00010000:00010000:1.0:1789445829.961496:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445829.961511:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f000/0xc1b37c4d472561cc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445829.961525:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f000/0xc1b37c4d472561cc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445829.972246:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445829.972443:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722065152 00000100:00100000:0.0:1789445829.972465:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722065152 00000100:00100000:0.0:1789445829.972520:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 16 00000100:00100000:0.0:1789445829.972544:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:9725:x1876369722065152:12345-192.168.206.59@tcp:101:chmod.0 00010000:00010000:0.0:1789445829.972566:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445829.972589:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d472561d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4adc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445829.972664:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d472561da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445829.972678:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d472561da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445829.972693:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d472561da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445829.972737:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789445829.972741:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789445829.972777:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d472561da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445829.972807:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d472561d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4adc expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445829.972829:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d472561da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4adc expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445829.972837:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961e00) 00010000:00010000:0.0:1789445829.972841:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789445829.972845:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e988c00, rc 0) 00000100:00100000:0.0:1789445829.972906:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:9725:x1876369722065152:12345-192.168.206.59@tcp:101:chmod.0 Request processed in 364us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445829.972923:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 16 00000100:00100000:0.0:1789445829.977098:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445829.977138:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722065408 00000100:00100000:0.0:1789445829.977147:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722065408 00000100:00100000:0.0:1789445829.977198:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 17 00000100:00100000:0.0:1789445829.977208:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:9725:x1876369722065408:12345-192.168.206.59@tcp:36:chmod.0 00010000:00010000:0.0:1789445829.977260:0:8204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445829.977284:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d472561da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4adc expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445829.977301:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961e00) 00010000:00010000:0.0:1789445829.977312:0:8204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789445829.977338:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472561e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445829.977351:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472561e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445829.977361:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472561e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789445829.977638:0:8204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000947c575b reply state 0000000050a1b24b transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472561e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445829.977648:0:8204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789445829.977656:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789445829.977730:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:9725:x1876369722065408:12345-192.168.206.59@tcp:36:chmod.0 Request processed in 522us (643us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789445829.977738:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 17 00010000:00010000:3.0:1789445829.994415:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472561e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445829.994442:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472561e1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445829.994466:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472561e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445829.994473:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445829.994478:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472561e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445829.994486:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472561e1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445829.994507:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961800) 00010000:00010000:3.0:1789445829.994510:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789445829.994524:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472561e1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445829.994531:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472561e1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445830.004542:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445830.010155:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722065536 00000100:00100000:3.0:1789445830.010171:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722065536 00000100:00100000:3.0:1789445830.010229:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 18 00000100:00100000:3.0:1789445830.010240:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:9726:x1876369722065536:12345-192.168.206.59@tcp:101:chown.0 00010000:00010000:3.0:1789445830.010261:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445830.010399:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472561e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ae3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.010745:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472561ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.010758:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472561ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.010782:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472561ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445830.010816:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789445830.010820:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789445830.010857:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472561ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.010883:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472561e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ae3 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.010901:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472561ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ae3 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.010910:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe8e97a900) 00010000:00010000:3.0:1789445830.011072:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789445830.011076:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fce00, rc 0) 00000100:00100000:3.0:1789445830.011142:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:9726:x1876369722065536:12345-192.168.206.59@tcp:101:chown.0 Request processed in 903us (6607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445830.011150:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 18 00000100:00100000:2.0:1789445830.013736:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445830.013826:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722065664 00000100:00100000:0.0:1789445830.013834:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722065664 00000100:00100000:0.0:1789445830.013917:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 19 00000100:00100000:0.0:1789445830.013928:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:9726:x1876369722065664:12345-192.168.206.59@tcp:101:chown.0 00010000:00010000:0.0:1789445830.013947:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445830.013965:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d472561f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4aea expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014035:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472561fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014163:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472561fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014177:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472561fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014195:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256204 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014203:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014210:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014300:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d4725620b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014308:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d4725620b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014329:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d4725620b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445830.014360:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789445830.014364:0:8204:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789445830.014383:0:8204:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d4725620b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014394:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472561fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014401:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472561fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014408:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472561fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014589:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445830.014595:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472561fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014603:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472561fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014614:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe8e97a900) 00010000:00010000:0.0:1789445830.014617:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445830.014621:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472561fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014638:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472561fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014665:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014671:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256204 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014677:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256204 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014682:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445830.014685:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256204 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014691:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256204 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014699:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9afe98961e00) 00010000:00010000:0.0:1789445830.014701:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445830.014704:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256204 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014709:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256204 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014744:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d472561f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4aea expref: 10 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014759:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d4725620b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4aea expref: 9 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.014779:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9afe98961200) 00010000:00010000:0.0:1789445830.014782:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789445830.014785:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e988800, rc 0) 00000100:00100000:0.0:1789445830.014897:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:9726:x1876369722065664:12345-192.168.206.59@tcp:101:chown.0 Request processed in 969us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445830.014906:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 19 00000100:00100000:3.0:1789445830.018882:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445830.019097:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722065920 00000100:00100000:0.0:1789445830.019109:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722065920 00000100:00100000:0.0:1789445830.019168:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 20 00000100:00100000:0.0:1789445830.019181:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:9726:x1876369722065920:12345-192.168.206.59@tcp:36:chown.0 00010000:00010000:0.0:1789445830.019230:0:8204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445830.019254:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d4725620b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4aea expref: 9 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.019285:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9afe98961200) 00010000:00010000:0.0:1789445830.019297:0:8204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789445830.019321:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256212 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.019334:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.019344:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789445830.138189:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1789445830.138274:0:8204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007286fcf reply state 000000003feb400b transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445830.138306:0:8204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789445830.138319:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1789445830.138416:0:8204:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789445830.138447:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:9726:x1876369722065920:12345-192.168.206.59@tcp:36:chown.0 Request processed in 119257us (119563us total) trans 4294967299 rc 0/0 00010000:00010000:3.0:1789445830.138863:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.138874:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256212 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.138882:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256212 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.138896:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445830.138901:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256212 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.138909:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256212 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.138925:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:3.0:1789445830.138928:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789445830.138944:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256212 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.138951:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256212 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445830.139185:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 20 00000100:00100000:3.0:1789445830.189775:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445830.190001:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722066048 00000100:00100000:2.0:1789445830.190010:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722066048 00000100:00100000:2.0:1789445830.190118:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 21 00000100:00100000:2.0:1789445830.190128:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:9727:x1876369722066048:12345-192.168.206.59@tcp:101:touch.500 00010000:00010000:2.0:1789445830.190150:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445830.190169:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfa00/0xc1b37c4d47256219 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4af1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789445830.193158:0:5841:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2941us 00010000:00010000:0.0:1789445830.234040:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256220 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.234089:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256220 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.234101:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256220 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.234116:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d47256227 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.234123:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d47256227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.234129:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d47256227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.234457:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d4725622e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.234466:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d4725622e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.234483:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d4725622e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445830.234506:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789445830.234509:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789445830.234544:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d4725622e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.238398:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256220 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.238416:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256220 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.238424:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256220 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.238430:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445830.238435:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256220 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.238443:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256220 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.238617:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe8e97a900) 00010000:00010000:0.0:1789445830.238635:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445830.238641:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256220 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.238647:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256220 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.238680:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d47256227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.238686:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d47256227 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.238692:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d47256227 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.238697:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445830.238700:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d47256227 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.238707:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d47256227 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.238715:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9afe98961200) 00010000:00010000:0.0:1789445830.238718:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445830.238721:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d47256227 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.238727:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d47256227 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.238775:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfa00/0xc1b37c4d47256219 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4af1 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.238791:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d4725622e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4af1 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.238811:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9afe98961e00) 00010000:00010000:0.0:1789445830.238813:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789445830.238815:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e988c00, rc 0) 00000100:00100000:0.0:1789445830.238894:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:9727:x1876369722066048:12345-192.168.206.59@tcp:101:touch.500 Request processed in 48766us (49126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445830.238907:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 21 00000100:00100000:2.0:1789445830.249772:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445830.249897:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722066304 00000100:00100000:3.0:1789445830.249907:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722066304 00000100:00100000:3.0:1789445830.250001:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 22 00000100:00100000:3.0:1789445830.250012:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:9727:x1876369722066304:12345-192.168.206.59@tcp:101:touch.500 00010000:00010000:3.0:1789445830.250032:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445830.250076:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256235 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4af8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.250339:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d4725623c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.250354:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d4725623c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.250376:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d4725623c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.250392:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256243 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.250399:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256243 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.250406:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256243 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789445830.251204:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789445830.251469:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725624a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.251481:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725624a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.251489:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725624a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.251523:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d4725623c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.251530:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d4725623c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.251536:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d4725623c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.251542:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445830.251552:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d4725623c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.251559:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d4725623c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.251570:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9afe98961e00) 00010000:00010000:3.0:1789445830.251574:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445830.251578:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d4725623c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.251585:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d4725623c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789445830.251599:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ac6f9fc reply state 00000000205c6558 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256243 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445830.251607:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789445830.251648:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256235 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4af8 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.251662:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725624a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4af8 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.251669:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9afe8e97a500) 00010000:00010000:3.0:1789445830.251672:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789445830.251674:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fc600, rc 0) 00000100:00100000:3.0:1789445830.251754:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+10:9727:x1876369722066304:12345-192.168.206.59@tcp:101:touch.500 Request processed in 1743us (1990us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789445830.251760:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 22 00000100:00100000:2.0:1789445830.263087:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00010000:00010000:3.0:1789445830.263185:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256243 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.263198:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256243 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.263206:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256243 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.263213:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445830.263218:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256243 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.263226:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256243 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.263244:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1dc871bf (ffff9afe8e97a600) 00010000:00010000:3.0:1789445830.263248:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445830.263253:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256243 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.263260:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256243 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445830.263473:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722066560 00000100:00100000:1.0:1789445830.263483:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722066560 00000100:00100000:1.0:1789445830.263529:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 23 00000100:00100000:1.0:1789445830.263539:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:9727:x1876369722066560:12345-192.168.206.59@tcp:36:touch.500 00010000:00010000:1.0:1789445830.263596:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445830.263615:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725624a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4af8 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.263639:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9afe8e97a500) 00010000:00010000:1.0:1789445830.263646:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789445830.263692:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d47256258 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.263707:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d47256258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.263717:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d47256258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789445830.263863:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f70656d5 reply state 00000000fd9c8488 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d47256258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445830.263891:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789445830.263998:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+10:9727:x1876369722066560:12345-192.168.206.59@tcp:36:touch.500 Request processed in 459us (918us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789445830.264006:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 23 00010000:00010000:3.0:1789445830.271702:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d47256258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.271724:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d47256258 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.271733:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d47256258 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.271759:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6fc00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445830.271764:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d47256258 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.271773:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d47256258 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.271793:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:3.0:1789445830.271797:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445830.271803:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d47256258 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.271810:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fc00/0xc1b37c4d47256258 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445830.277099:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445830.277222:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722066688 00000100:00100000:0.0:1789445830.277233:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722066688 00000100:00100000:0.0:1789445830.277294:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 24 00000100:00100000:0.0:1789445830.277305:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:9727:x1876369722066688:12345-192.168.206.59@tcp:101:touch.500 00010000:00010000:0.0:1789445830.277329:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445830.277352:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d4725625f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4aff expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.277407:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d4725625f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4aff expref: 10 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.277422:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d4725625f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4aff expref: 10 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.277446:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9afe98961200) 00010000:00010000:0.0:1789445830.277450:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789445830.277453:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989200, rc 0) 00000100:00100000:0.0:1789445830.277514:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+10:9727:x1876369722066688:12345-192.168.206.59@tcp:101:touch.500 Request processed in 212us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445830.277537:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 24 00000100:00100000:1.0:1789445830.290885:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445830.290990:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722066816 00000100:00100000:2.0:1789445830.291001:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722066816 00000100:00100000:2.0:1789445830.291085:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 16 00000100:00100000:2.0:1789445830.291094:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2373:x1876369722066816:12345-192.168.206.59@tcp:8:touch.500 00010000:00080000:2.0:1789445830.291124:0:6685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:2.0:1789445830.291154:0:6685:0:(genops.c:1384:class_connect()) connect: client 4a94602d-5f10-4cb2-abf8-c0de02603d85, cookie 0xc1b37c4d47256266 00002000:00100000:2.0:1789445830.291166:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4a94602d-5f10-4cb2-abf8-c0de02603d85/ffff9afeba5bd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789445830.291187:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789445830.291399:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789445830.291426:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9afeba5ba000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789445830.291495:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2373:x1876369722066816:12345-192.168.206.59@tcp:8:touch.500 Request processed in 401us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445830.291502:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 16 00000100:00100000:2.0:1789445830.293820:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445830.293926:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722066944 00000100:00100000:0.0:1789445830.293937:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722066944 00000100:00100000:0.0:1789445830.294010:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 17 00000100:00100000:0.0:1789445830.294022:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:0:x1876369722066944:12345-192.168.206.59@tcp:2:touch.500 00000100:00080000:1.0:1789445830.294469:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789445830.352336:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:0:x1876369722066944:12345-192.168.206.59@tcp:2:touch.500 Request processed in 58308us (58516us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789445830.352348:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 17 00000001:00080000:0.0:1789445830.352379:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1789445830.352390:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4a94602d-5f10-4cb2-abf8-c0de02603d85 00000100:00100000:0.0:1789445830.361808:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445830.362082:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722067200 00000100:00100000:1.0:1789445830.362091:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722067200 00000100:00100000:1.0:1789445830.362146:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 2 00000100:00100000:1.0:1789445830.362156:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+10:9727:x1876369722067200:12345-192.168.206.59@tcp:35:touch.500 00000100:00100000:1.0:1789445830.362525:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+11:9727:x1876369722067200:12345-192.168.206.59@tcp:35:touch.500 Request processed in 369us (725us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789445830.362533:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 2 00010000:00010000:1.0:1789445830.363369:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445830.397156:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445830.397252:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722067328 00000100:00100000:1.0:1789445830.397261:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722067328 00000100:00100000:1.0:1789445830.397320:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 25 00000100:00100000:1.0:1789445830.397330:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+11:9728:x1876369722067328:12345-192.168.206.59@tcp:101:rm.0 00010000:00010000:1.0:1789445830.397355:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445830.397376:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e400/0xc1b37c4d4725626d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b06 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.397465:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256274 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.397481:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.397506:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445830.397539:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789445830.397543:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789445830.397579:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.397604:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e400/0xc1b37c4d4725626d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b06 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.397622:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256274 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b06 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.397642:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9afe98961e00) 00010000:00010000:1.0:1789445830.397645:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789445830.397649:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6ec00, rc 0) 00000100:00100000:1.0:1789445830.397705:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+12:9728:x1876369722067328:12345-192.168.206.59@tcp:101:rm.0 Request processed in 376us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445830.397712:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 25 00000100:00100000:3.0:1789445830.400462:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445830.400560:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722067584 00000100:00100000:0.0:1789445830.400570:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722067584 00000100:00100000:0.0:1789445830.400621:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 26 00000100:00100000:0.0:1789445830.400642:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+12:9728:x1876369722067584:12345-192.168.206.59@tcp:101:rm.0 00010000:00010000:0.0:1789445830.400661:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445830.400679:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d4725627b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b0d expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445830.400756:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789445830.401007:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d4725627b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b0d expref: 14 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.401023:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe8e97a900) 00010000:00010000:0.0:1789445830.401026:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789445830.401089:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d4725627b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b0d expref: 14 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.401106:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e988800, rc 0) 00000100:00100000:0.0:1789445830.401164:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:9728:x1876369722067584:12345-192.168.206.59@tcp:101:rm.0 Request processed in 524us (711us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1789445830.401170:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 26 00000100:00100000:0.0:1789445830.405094:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445830.405197:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722067712 00000100:00100000:1.0:1789445830.405206:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722067712 00000100:00100000:1.0:1789445830.405263:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 3 00000100:00100000:1.0:1789445830.405273:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:9728:x1876369722067712:12345-192.168.206.59@tcp:37:rm.0 00000100:00100000:2.0:1789445830.424705:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:9728:x1876369722067712:12345-192.168.206.59@tcp:37:rm.0 Request processed in 19423us (19608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445830.424718:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 3 00000100:00100000:3.0:1789445830.428122:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445830.428209:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722067968 00000100:00100000:0.0:1789445830.428218:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722067968 00000100:00100000:0.0:1789445830.428271:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 4 00000100:00100000:0.0:1789445830.428280:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fce850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:9728:x1876369722067968:12345-192.168.206.59@tcp:35:rm.0 00000100:00100000:0.0:1789445830.428493:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fce850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:9728:x1876369722067968:12345-192.168.206.59@tcp:35:rm.0 Request processed in 214us (380us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789445830.428501:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 4 00000100:00100000:0.0:1789445830.431368:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445830.431467:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722068224 00000100:00100000:1.0:1789445830.431476:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722068224 00000100:00100000:1.0:1789445830.431530:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 27 00000100:00100000:1.0:1789445830.431540:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:9728:x1876369722068224:12345-192.168.206.59@tcp:101:rm.0 00010000:00010000:1.0:1789445830.431574:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445830.431592:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256289 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b14 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.431691:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256290 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.431706:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256290 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.431717:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256290 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445830.431729:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789445830.431860:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256289 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b14 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.431878:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256290 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b14 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.431886:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9afe98961e00) 00010000:00010000:1.0:1789445830.431889:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789445830.431893:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6fe00, rc 0) 00000100:00100000:1.0:1789445830.431946:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+16:9728:x1876369722068224:12345-192.168.206.59@tcp:101:rm.0 Request processed in 408us (585us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789445830.431953:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 27 00000100:00100000:1.0:1789445830.435128:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445830.435209:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722068352 00000100:00100000:0.0:1789445830.435219:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722068352 00000100:00100000:0.0:1789445830.435267:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 28 00000100:00100000:0.0:1789445830.435277:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+16:9728:x1876369722068352:12345-192.168.206.59@tcp:41:rm.0 00000004:00000024:0.0:1789445830.435330:0:8204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789445830.435398:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+16:9728:x1876369722068352:12345-192.168.206.59@tcp:41:rm.0 Request processed in 122us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445830.435405:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 28 00000100:00100000:3.0:1789445830.437713:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445830.437794:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722068480 00000100:00100000:1.0:1789445830.437803:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722068480 00000100:00100000:1.0:1789445830.437868:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 29 00000100:00100000:1.0:1789445830.437878:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+16:9728:x1876369722068480:12345-192.168.206.59@tcp:101:rm.0 00010000:00010000:1.0:1789445830.437895:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445830.437917:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d4725629e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438007:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472562a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438024:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472562a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438035:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472562a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438079:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ea00/0xc1b37c4d472562ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438086:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ea00/0xc1b37c4d472562ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438092:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ea00/0xc1b37c4d472562ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438191:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d472562b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438199:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d472562b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438206:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d472562b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445830.438241:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789445830.438245:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789445830.438263:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d472562b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438273:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d472562b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438281:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472562a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438287:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472562a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438294:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472562a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438299:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445830.438303:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472562a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438310:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472562a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438320:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9afe98961e00) 00010000:00010000:1.0:1789445830.438323:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445830.438327:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472562a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438333:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472562a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438356:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ea00/0xc1b37c4d472562ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438362:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ea00/0xc1b37c4d472562ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438367:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ea00/0xc1b37c4d472562ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438372:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6ea00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445830.438374:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ea00/0xc1b37c4d472562ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438379:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ea00/0xc1b37c4d472562ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438387:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1dc871bf (ffff9afe858f5600) 00010000:00010000:1.0:1789445830.438389:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445830.438391:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ea00/0xc1b37c4d472562ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438397:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ea00/0xc1b37c4d472562ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438426:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d4725629e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b1b expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438638:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d472562b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b1b expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445830.438656:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9afe98961200) 00010000:00010000:1.0:1789445830.438659:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789445830.438661:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6f200, rc 0) 00000100:00100000:1.0:1789445830.438713:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+17:9728:x1876369722068480:12345-192.168.206.59@tcp:101:rm.0 Request processed in 837us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445830.438720:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 29 00000100:00100000:2.0:1789445830.442373:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445830.442592:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722068736 00000100:00100000:0.0:1789445830.442601:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722068736 00000100:00100000:0.0:1789445830.442658:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 30 00000100:00100000:0.0:1789445830.442676:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+17:9728:x1876369722068736:12345-192.168.206.59@tcp:36:rm.0 00010000:00010000:0.0:1789445830.442721:0:8204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789445830.442742:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d472562b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b1b expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.442760:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d4725625f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4aff expref: 16 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.442770:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9afe98961200) 00010000:00010000:0.0:1789445830.442783:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256274 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b06 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.442790:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9afe98961e00) 00010000:00010000:0.0:1789445830.442793:0:8204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789445830.442809:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d472562ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.442820:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d472562ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.442829:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d472562ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.442841:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472562c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.442847:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472562c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.442854:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472562c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.442949:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472562c8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.442957:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472562c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.442964:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472562c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789445830.443973:0:8204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789445830.443984:0:8204:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 268465938363ns, next at 269465935945ns, rc = 0 00010000:00010000:0.0:1789445830.444150:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472562cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444163:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472562cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444171:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472562cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444179:0:8204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472562cf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444186:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472562cf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444192:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472562cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444203:0:8204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789445830.444220:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472562c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444230:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472562c8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444237:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472562c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444242:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445830.444246:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472562c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444253:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472562c8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444262:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:0.0:1789445830.444265:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789445830.444268:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472562c8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444274:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d472562c8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444289:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d472562ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444295:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d472562ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444301:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d472562ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444306:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445830.444312:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d472562ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444319:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d472562ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444326:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9afe98961e00) 00010000:00010000:0.0:1789445830.444327:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445830.444330:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d472562ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445830.444335:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d472562ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789445830.444343:0:8204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf597ce5 reply state 0000000062e64dff transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472562c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445830.444351:0:8204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789445830.444441:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+16:9728:x1876369722068736:12345-192.168.206.59@tcp:36:rm.0 Request processed in 1759us (2068us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789445830.444449:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 30 00010000:00010000:2.0:1789445830.447256:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445830.447271:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472562cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445830.447282:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907600 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445830.447287:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472562cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445830.447297:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472562cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445830.447315:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:2.0:1789445830.447318:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789445830.447323:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472562cf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445830.447329:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472562cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445830.447355:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445830.447357:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445830.447359:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445830.448380:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472562c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.448395:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472562c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.448402:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472562c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.448408:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445830.448423:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472562c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.448458:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472562c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.448473:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1dc871bf (ffff9afe98961000) 00010000:00010000:3.0:1789445830.448476:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445830.448480:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472562c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.448486:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d472562c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1dc871bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445830.450227:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445830.450727:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722068992 00000100:00100000:0.0:1789445830.450736:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722068992 00000100:00100000:0.0:1789445830.450792:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 5 00000100:00100000:0.0:1789445830.450803:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:9728:x1876369722068992:12345-192.168.206.59@tcp:35:rm.0 00000100:00100000:0.0:1789445830.451033:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+16:9728:x1876369722068992:12345-192.168.206.59@tcp:35:rm.0 Request processed in 232us (814us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789445830.451040:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 5 00000100:00100000:0.0:1789445830.457404:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445830.457613:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722069248 00000100:00100000:3.0:1789445830.457623:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722069248 00000100:00100000:3.0:1789445830.457694:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 31 00000100:00100000:3.0:1789445830.457704:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+16:9728:x1876369722069248:12345-192.168.206.59@tcp:36:rm.0 00010000:00010000:3.0:1789445830.457761:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789445830.457785:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256290 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b14 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.457807:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d4725622e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4af1 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.457818:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9afe98961e00) 00010000:00010000:3.0:1789445830.457831:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472561ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ae3 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.457841:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe8e97a900) 00010000:00010000:3.0:1789445830.457862:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789445830.457885:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472562d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.457898:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472562d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.457908:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472562d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.457919:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472562dd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.457926:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472562dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.457932:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472562dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.458212:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d472562e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.458222:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d472562e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.458229:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d472562e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445830.458970:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789445830.458989:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d472562e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.458998:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d472562e4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.459011:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d472562e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.459018:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445830.459022:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d472562e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.459031:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d472562e4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.459042:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9afe8e97ac00) 00010000:00010000:3.0:1789445830.459065:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789445830.459070:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d472562e4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.459077:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d472562e4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.459097:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472562d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.459104:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472562d6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.459110:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472562d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.459116:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445830.459119:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472562d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.459135:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472562d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.459144:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe8e97af00) 00010000:00010000:3.0:1789445830.459147:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445830.459150:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472562d6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.459157:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472562d6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789445830.459168:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d88a6fed reply state 00000000369ca6a2 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472562dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445830.459177:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789445830.459250:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:9728:x1876369722069248:12345-192.168.206.59@tcp:36:rm.0 Request processed in 1545us (1852us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789445830.459259:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 31 00010000:00010000:3.0:1789445830.468465:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472562dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.468482:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472562dd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.468490:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472562dd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.468496:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fd200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445830.468502:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472562dd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.468530:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472562dd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.468546:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9afe8e97a600) 00010000:00010000:3.0:1789445830.468549:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445830.468554:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472562dd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445830.468560:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472562dd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445830.747313:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742023808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789445830.747411:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445830.747819:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742023808 00000100:00100000:2.0:1789445830.747829:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742023808 00000100:00100000:2.0:1789445830.747909:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789445830.747923:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742023808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789445830.747963:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789445830.748022:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742023808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445830.748041:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1789445830.748135:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789445830.748204:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf762680 x1876369742023808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445830.748232:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742023808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789445831.202146:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445831.202204:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445831.202250:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445831.202286:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722069632 00000100:00100000:0.0:1789445831.202299:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722069632 00000100:00100000:0.0:1789445831.202381:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 92 00000100:00100000:0.0:1789445831.202395:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2376:x1876369722069632:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445831.202454:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722069376 00000100:00100000:1.0:1789445831.202458:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722069376 00000100:00100000:1.0:1789445831.202490:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 246 00000100:00100000:1.0:1789445831.202498:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2376:x1876369722069376:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445831.202499:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2376:x1876369722069632:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 109us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445831.202507:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 92 00000100:00100000:1.0:1789445831.202526:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2376:x1876369722069376:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 30us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445831.202532:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 246 00000100:00080000:1.0:1789445831.202561:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445831.202653:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722069504 00000100:00100000:3.0:1789445831.202658:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722069504 00000100:00100000:3.0:1789445831.202697:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 52 00000100:00100000:3.0:1789445831.202704:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2377:x1876369722069504:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445831.202742:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2377:x1876369722069504:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 38us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445831.202748:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 52 00010000:00010000:0.0:1789445831.389908:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445832.418559:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445832.796416:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742024192:0@lo:400:kworker.0 00000100:00100000:1.0:1789445832.796503:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445832.796558:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789445832.796565:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742024320:0@lo:400:kworker.0 00000100:00100000:1.0:1789445832.796591:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445832.801153:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742023936:0@lo:400:kworker.0 00000100:00100000:3.0:1789445832.801237:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445832.801279:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742024448:0@lo:400:kworker.0 00000100:00100000:3.0:1789445832.801305:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445832.801336:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789445832.801343:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742024064:0@lo:400:kworker.0 00000100:00100000:3.0:1789445832.801367:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445832.801392:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742024576:0@lo:400:kworker.0 00000100:00100000:3.0:1789445832.801435:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445832.801471:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742024192 00000100:00100000:3.0:1789445832.801478:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742024192 00000100:00100000:3.0:1789445832.801532:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742024448 00000100:00100000:3.0:1789445832.801536:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742024448 00000100:00100000:3.0:1789445832.801551:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742024064 00000100:00100000:3.0:1789445832.801553:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742024064 00000100:00100000:3.0:1789445832.801568:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789445832.801576:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742024192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445832.801644:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742024192:12345-0@lo:400:kworker.0 Request processed in 68us (5141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445832.801651:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789445832.801670:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789445832.801679:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742024448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445832.801711:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742024448:12345-0@lo:400:kworker.0 Request processed in 32us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445832.801716:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789445832.801727:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789445832.801732:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742024064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445832.801773:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742024064:12345-0@lo:400:kworker.0 Request processed in 41us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445832.801778:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789445832.801797:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742024320 00000100:00100000:3.0:1789445832.801800:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742024320 00000100:00100000:3.0:1789445832.801821:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742024576 00000100:00100000:3.0:1789445832.801823:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742024576 00000100:00100000:3.0:1789445832.801836:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789445832.801841:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742024320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445832.801878:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742024320:12345-0@lo:400:kworker.0 Request processed in 37us (5287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445832.801884:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789445832.801896:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789445832.801902:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742024576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445832.801930:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742024576:12345-0@lo:400:kworker.0 Request processed in 29us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445832.801935:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1789445832.801951:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789445832.801954:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789445832.801957:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789445832.802020:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afe9192e680 x1876369742024320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445832.802035:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742024320:0@lo:400:kworker.0 00000100:00100000:3.0:1789445832.802072:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742024192:0@lo:400:kworker.0 00000100:00100000:3.0:1789445832.802103:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742024064:0@lo:400:kworker.0 00010000:00080000:3.0:1789445832.802112:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afe9192f480 x1876369742024576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445832.802119:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742024576:0@lo:400:kworker.0 00000100:00100000:3.0:1789445832.802127:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742024448:0@lo:400:kworker.0 00000100:00100000:1.0:1789445832.802455:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742023936 00000100:00100000:1.0:1789445832.802459:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742023936 00000100:00100000:1.0:1789445832.802499:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789445832.802506:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3312:x1876369742023936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445832.802563:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3312:x1876369742023936:12345-0@lo:400:kworker.0 Request processed in 57us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445832.802569:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789445832.803633:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3312:1876369742023936:0@lo:400:kworker.0 00000004:00080000:3.0:1789445833.315406:0:7985:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 271337356832ns, next at 272337345352ns, rc = 0 00000100:00100000:1.0:1789445833.315523:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742024704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789445833.315640:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445833.315812:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742024704 00000100:00100000:3.0:1789445833.315836:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742024704 00000100:00100000:3.0:1789445833.315906:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789445833.315919:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742024704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789445833.315964:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789445833.316090:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742024704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 173us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445833.316098:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1789445833.316156:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb575d180 x1876369742024704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445833.316181:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742024704:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789445833.436626:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445834.458338:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789445834.949893:0:11607:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:0.0:1789445835.401840:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1789445835.401865:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:0.0:1789445835.401895:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1789445835.401906:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:3.0:1789445835.402273:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789445835.402294:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742024832:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789445835.402374:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445835.402481:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742024832 00000100:00100000:0.0:1789445835.402490:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742024832 00000100:00100000:0.0:1789445835.402554:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789445835.402565:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742024832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789445835.402592:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1789445835.402639:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa8c6c6, atime: 0x6aa8c6c6, ctime: 0x6aa8c6c6, blocks: 0x1 00010000:00010000:0.0:1789445835.402676:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472562eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445835.402694:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=273s v=(0 0) 00010000:00010000:0.0:1789445835.402699:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445835.402707:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472562eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789445835.402724:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789445835.402725:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472562eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445835.402735:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472562eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445835.402744:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472562eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445835.402765:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789445835.402839:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789445835.402848:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472562eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.402857:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907200 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445835.402862:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472562eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.402871:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472562eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.402889:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472562eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.402896:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472562eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.402913:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445835.402915:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445835.402917:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445835.403403:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1876369742024832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 838us (1026us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789445835.403421:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1789445835.403588:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afeb5c78700/2, rc 0, transno 4294967300 00000100:00100000:3.0:1789445835.403596:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742024832:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789445835.482147:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445835.867108:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742024960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789445835.867195:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445835.868069:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742024960 00000100:00100000:0.0:1789445835.868081:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742024960 00000100:00100000:0.0:1789445835.868141:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789445835.868151:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742024960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789445835.868188:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789445835.868282:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789445835.880329:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742024960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12161us (13115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445835.880354:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789445835.882808:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf760700 x1876369742024960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445835.882837:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742024960:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1789445835.929538:0:11658:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda00d76b0 20000000:00000080:0.0:1789445835.929557:0:11658:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9afeb5afbc00 uarg=0000000000000000 20000000:01000000:0.0:1789445835.929615:0:11658:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789445835.929621:0:11658:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789445835.929627:0:11658:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1789445835.934650:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789445835.936462:0:11658:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789445835.949354:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789445835.949615:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789445835.949682:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789445835.949705:0:11658:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789445835.949726:0:11658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afea4907800/0xc1b37c4d472562f2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445835.949746:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afeb57be000/0xc1b37c4d4725618d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ace expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445835.949755:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256194 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ad5 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445835.949764:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe813fda00/0xc1b37c4d472561a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d4725619b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445835.949771:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe91b6e800/0xc1b37c4d472561b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472561a9 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445835.949777:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe91b6e000/0xc1b37c4d472561be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472561b7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445835.949785:0:11658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afea4907800/0xc1b37c4d472562f2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445835.949832:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe91b6e000/0xc1b37c4d472561be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d472561b7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445835.949849:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe91b6e000/0xc1b37c4d472561be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d472561b7 expref: 18 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445835.949864:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1876369742025088:0@lo:104: 00000100:00100000:0.0:1789445835.949927:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789445835.950000:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe91b6e800/0xc1b37c4d472561b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d472561a9 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445835.950009:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe91b6e800/0xc1b37c4d472561b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d472561a9 expref: 18 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445835.950019:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1876369742025216:0@lo:104: 00000100:00100000:0.0:1789445835.950110:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789445835.950167:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe813fda00/0xc1b37c4d472561a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d4725619b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445835.950175:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afe813fda00/0xc1b37c4d472561a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d4725619b expref: 18 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445835.950183:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1876369742025344:0@lo:104: 00000100:00100000:0.0:1789445835.950207:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445835.950255:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1789445835.950260:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ad5 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445835.950271:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742025088 00000100:00100000:1.0:1789445835.950273:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742025216 00010000:00010000:0.0:1789445835.950275:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256194 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ad5 expref: 12 pid: 5836 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445835.950280:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742025088 00000100:00100000:1.0:1789445835.950281:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742025216 00000100:00100000:0.0:1789445835.950302:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e46300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1876369742025472:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445835.950322:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742025344 00000100:00100000:2.0:1789445835.950337:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742025344 00000100:00100000:3.0:1789445835.950385:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789445835.950398:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba628000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:11658:x1876369742025088:12345-0@lo:104: 00010000:00010000:3.0:1789445835.950419:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe8e989000/0xc1b37c4d472561b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d472561be expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445835.950427:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789445835.950439:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf614e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:11658:x1876369742025216:12345-0@lo:104: 00010000:00010000:1.0:1789445835.950449:0:7626:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe8e989400/0xc1b37c4d472561a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d472561b0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445835.950480:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789445835.950487:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba628000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:11658:x1876369742025088:12345-0@lo:104: Request processed in 92us (560us total) trans 0 rc 0/0 00010000:00010000:1.0:1789445835.950500:0:7626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789445835.950501:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789445835.950509:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf614e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+5:11658:x1876369742025216:12345-0@lo:104: Request processed in 72us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445835.950517:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789445835.950541:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789445835.950549:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe8e989000/0xc1b37c4d472561b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d472561be expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.950559:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989000 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:1.0:1789445835.950564:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e989000/0xc1b37c4d472561b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d472561be expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.950573:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe8e989000/0xc1b37c4d472561b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d472561be expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789445835.950580:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e989000/0xc1b37c4d472561b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d472561be expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445835.950586:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789445835.950627:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe8e989000/0xc1b37c4d472561b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d472561be expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.950633:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789445835.950658:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe8e989000/0xc1b37c4d472561b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d472561be expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.950665:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe8e989000/0xc1b37c4d472561b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d472561be expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.950676:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789445835.950679:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe8e989400/0xc1b37c4d472561a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d472561b0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.950685:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989400 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:1.0:1789445835.950688:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e989400/0xc1b37c4d472561a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d472561b0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.950695:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe8e989400/0xc1b37c4d472561a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d472561b0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789445835.950701:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e989400/0xc1b37c4d472561a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d472561b0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445835.950707:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789445835.950717:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe8e989400/0xc1b37c4d472561a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d472561b0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.950723:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789445835.950736:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe8e989400/0xc1b37c4d472561a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d472561b0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.950743:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe8e989400/0xc1b37c4d472561a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d472561b0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.950751:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445835.950756:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445835.950758:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445835.950770:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742025600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789445835.950802:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445835.950827:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789445835.950836:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369742025728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789445835.950839:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5afb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:11658:x1876369742025344:12345-0@lo:104: 00010000:00010000:2.0:1789445835.950850:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d4725619b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d472561a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445835.950861:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445835.950891:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742025600 00000100:00100000:1.0:1789445835.950895:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742025600 00010000:00010000:2.0:1789445835.950906:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789445835.950914:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe91b6e000/0xc1b37c4d472561be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d472561b7 expref: 19 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445835.950915:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5afb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+3:11658:x1876369742025344:12345-0@lo:104: Request processed in 79us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445835.950932:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789445835.950943:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742025728 00000100:00100000:1.0:1789445835.950946:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742025728 00010000:00010000:1.0:1789445835.950956:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe91b6e800/0xc1b37c4d472561b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d472561a9 expref: 20 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445835.950974:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789445835.950980:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+20:3313:x1876369742025600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789445835.950990:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445835.950994:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe91b6e000/0xc1b37c4d472561be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d472561b7 expref: 20 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.951005:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe91b6e000/0xc1b37c4d472561be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d472561b7 expref: 20 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.951019:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445835.951041:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+20:3313:x1876369742025600:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (239us total) trans 0 rc 0/0 00010000:00010000:2.0:1789445835.951318:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445835.951325:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d4725619b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d472561a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445835.951403:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988000 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1789445835.951407:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d4725619b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d472561a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445835.951424:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d4725619b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d472561a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789445835.951431:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d4725619b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d472561a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445835.951437:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789445835.951453:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d4725619b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d472561a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445835.951460:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789445835.951476:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d4725619b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d472561a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445835.951483:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe8e988000/0xc1b37c4d4725619b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d472561a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445835.951499:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445835.951501:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445835.951502:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445835.951515:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789445835.951524:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5759500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+20:3310:x1876369742025728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789445835.951533:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445835.951538:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe91b6e800/0xc1b37c4d472561b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d472561a9 expref: 20 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445835.951547:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe91b6e800/0xc1b37c4d472561b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d472561a9 expref: 20 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445835.951570:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445835.951596:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5759500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+20:3310:x1876369742025728:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445835.951613:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789445835.951631:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789445835.951639:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742025856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789445835.951685:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742025600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789445835.952474:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445835.952533:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369742025728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789445835.952570:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445835.954839:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742025856 00000100:00100000:3.0:1789445835.954856:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742025856 00010000:00010000:3.0:1789445835.954905:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe813fda00/0xc1b37c4d472561a2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d4725619b expref: 19 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445835.954952:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789445835.954961:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe919b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742025856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789445835.954974:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445835.954980:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe813fda00/0xc1b37c4d472561a2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d4725619b expref: 19 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445835.954992:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe813fda00/0xc1b37c4d472561a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d4725619b expref: 19 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445835.955011:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445835.955120:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe919b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742025856:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (2646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445835.955168:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742025856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789445835.955184:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1789445835.955578:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afeb57be000/0xc1b37c4d4725618d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ace expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445835.955591:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afeb57be000/0xc1b37c4d4725618d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ace expref: 12 pid: 5836 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445835.955614:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e45880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1876369742025984:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445835.955646:0:11658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf5e6f00 going to sleep for 11 seconds 00010000:00010000:0.0:1789445835.955664:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe91b6e000/0xc1b37c4d472561be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d472561b7 expref: 18 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445835.955679:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1876369742025088:0@lo:104: 00010000:00010000:0.0:1789445835.955691:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe91b6e800/0xc1b37c4d472561b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d472561a9 expref: 17 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445835.955699:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1876369742025216:0@lo:104: 00010000:00010000:0.0:1789445835.955709:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe813fda00/0xc1b37c4d472561a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d4725619b expref: 16 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445835.955719:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1876369742025344:0@lo:104: 00000100:00100000:1.0:1789445835.973097:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445835.973158:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445835.973196:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722069760 00000100:00100000:1.0:1789445835.973207:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722069760 00000100:00100000:2.0:1789445835.973211:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e46300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1876369742025472:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445835.973226:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e45880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1876369742025984:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789445835.973256:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256194 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ad5 expref: 13 pid: 5836 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445835.973291:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722069888 00000100:00100000:1.0:1789445835.973295:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722069888 00010000:00010000:1.0:1789445835.973308:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afeb57be000/0xc1b37c4d4725618d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ace expref: 14 pid: 5836 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445835.973329:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 33 00000100:00100000:1.0:1789445835.973338:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eea72feb-e69e-4b1c-9967-d4ce1a915b88+14:2375:x1876369722069760:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789445835.973359:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445835.973365:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256194 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ad5 expref: 14 pid: 5836 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.973379:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ad5 expref: 14 pid: 5836 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.973399:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe813fde00/0xc1b37c4d47256194 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ad5 expref: 14 pid: 5836 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445835.973409:0:11658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afea4907800/0xc1b37c4d472562f2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.973418:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445835.973471:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2375:x1876369722069760:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 132us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445835.973480:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 33 00000100:00100000:1.0:1789445835.973517:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 34 00000100:00100000:1.0:1789445835.973524:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5758e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:2375:x1876369722069888:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789445835.973659:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445835.973665:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afeb57be000/0xc1b37c4d4725618d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ace expref: 12 pid: 5836 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.973675:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afeb57be000/0xc1b37c4d4725618d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ace expref: 12 pid: 5836 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.973686:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afeb57be000/0xc1b37c4d4725618d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ace expref: 12 pid: 5836 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.973699:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afea4907800/0xc1b37c4d472562f2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.973710:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afea4907800/0xc1b37c4d472562f2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.973726:0:7627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afea4907800/0xc1b37c4d472562f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.973733:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afea4907800/0xc1b37c4d472562f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.973740:0:7627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afea4907800/0xc1b37c4d472562f2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.973747:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afea4907800/0xc1b37c4d472562f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.973752:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907800 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445835.973762:0:7627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afea4907800/0xc1b37c4d472562f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.973770:0:7627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afea4907800/0xc1b37c4d472562f2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.973790:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afea4907800/0xc1b37c4d472562f2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445835.973798:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445835.973826:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5758e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eea72feb-e69e-4b1c-9967-d4ce1a915b88+11:2375:x1876369722069888:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 302us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445835.973833:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 34 00010000:00010000:2.0:1789445835.973870:0:11658:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afea4907800/0xc1b37c4d472562f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445835.973880:0:11658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afea4907800/0xc1b37c4d472562f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445835.973887:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afea4907800/0xc1b37c4d472562f2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445836.322954:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445836.322996:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445836.323034:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445836.323301:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722070016 00000100:00100000:3.0:1789445836.323312:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722070016 00000100:00100000:0.0:1789445836.323343:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722070272 00000100:00100000:0.0:1789445836.323347:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722070272 00000100:00100000:2.0:1789445836.323418:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722070144 00000100:00100000:2.0:1789445836.323423:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722070144 00000100:00100000:2.0:1789445836.323457:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 55 00000100:00100000:2.0:1789445836.323482:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2375:x1876369722070144:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445836.323562:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2375:x1876369722070144:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 83us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445836.323569:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 55 00000100:00100000:3.0:1789445836.323728:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 96 00000100:00100000:3.0:1789445836.323737:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2375:x1876369722070016:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445836.323841:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2375:x1876369722070016:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 52us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445836.323849:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 96 00000100:00100000:3.0:1789445836.323863:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 97 00000100:00100000:3.0:1789445836.323869:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2375:x1876369722070272:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445836.323904:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2375:x1876369722070272:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 34us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445836.323910:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 97 00000100:00080000:1.0:1789445836.324036:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789445836.324040:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789445836.508009:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789445837.215968:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789445837.215975:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afebb4dd000 from 7 10000000:01000000:0.0:1789445837.215980:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789445837.216031:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afea4906200/0xc1b37c4d472562f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445837.216085:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afea4906200/0xc1b37c4d472562f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445837.216097:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afea4906200/0xc1b37c4d472562f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445837.216120:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742026112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789445837.216181:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445837.216230:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf5e6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789445837.216392:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742026112 00000100:00100000:1.0:1789445837.216399:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742026112 00000100:00100000:1.0:1789445837.216492:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789445837.216501:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:5838:x1876369742026112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789445837.220890:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445837.220934:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe91b6f000/0xc1b37c4d47256300 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472562f9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445837.220974:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe91b6f000/0xc1b37c4d47256300 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472562f9 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445837.221101:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe91b6f000/0xc1b37c4d47256300 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472562f9 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445837.221123:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6f000, rc 0) 00000100:00100000:1.0:1789445837.221247:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742026112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4743us (5061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445837.221260:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789445837.221459:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742026112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789445837.221479:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afea4906200/0xc1b37c4d472562f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256300 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445837.221488:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afea4906200/0xc1b37c4d472562f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47256300 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445837.225736:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742026240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789445837.226832:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445837.230961:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf5e6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789445837.232217:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742026240 00000100:00100000:2.0:1789445837.232240:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742026240 00000100:00100000:2.0:1789445837.232325:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789445837.232344:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742026240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789445837.233406:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742026240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1064us (6572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445837.233418:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789445837.234332:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742026240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789445837.234438:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742026368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789445837.235248:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445837.235331:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf5e6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789445837.235451:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742026368 00000100:00100000:1.0:1789445837.235469:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742026368 00000100:00100000:1.0:1789445837.235573:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789445837.235588:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742026368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789445837.235943:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742026368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 359us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445837.235953:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789445837.236832:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742026368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789445837.239252:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:11671:1876369742026496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789445837.239358:0:11671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445837.239407:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf5e6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789445837.240497:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742026496 00000100:00100000:3.0:1789445837.240516:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742026496 00000100:00100000:3.0:1789445837.240619:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789445837.240633:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:11671:x1876369742026496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789445837.241003:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:11671:x1876369742026496:12345-0@lo:502:llog_process_th.0 Request processed in 372us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445837.241012:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789445837.241233:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:11671:1876369742026496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789445837.241285:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789445837.241311:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789445837.241315:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789445837.241324:0:11671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afebb4dd000 00000020:00000080:0.0:1789445837.241328:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789445837.241500:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:11671:1876369742026624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789445837.241565:0:11671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445837.241620:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf5e6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789445837.241857:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742026624 00000100:00100000:3.0:1789445837.241865:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742026624 00000100:00100000:3.0:1789445837.241919:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789445837.241928:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:11671:x1876369742026624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789445837.242173:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:11671:x1876369742026624:12345-0@lo:502:llog_process_th.0 Request processed in 246us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445837.242181:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789445837.243380:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:11671:1876369742026624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789445837.243531:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789445837.243541:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789445837.243544:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789445837.243550:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789445837.243672:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789445837.243705:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789445837.243722:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afea4906200/0xc1b37c4d472562f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256300 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445837.243736:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afea4906200/0xc1b37c4d472562f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256300 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445837.243749:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789445837.243752:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afe8533d800 from 7 10000000:01000000:2.0:1789445837.243755:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789445837.243799:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d47256307 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445837.243808:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d47256307 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445837.243820:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d47256307 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445837.243845:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf761c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742026752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789445837.243981:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445837.244101:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe914740c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445837.244152:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742026752 00000100:00100000:1.0:1789445837.244161:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742026752 00000100:00100000:1.0:1789445837.244248:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789445837.244259:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:5838:x1876369742026752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789445837.244276:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445837.244294:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe91b6f400/0xc1b37c4d4725630e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47256307 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445837.244327:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe91b6f400/0xc1b37c4d4725630e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47256307 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445837.244339:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe91b6f400/0xc1b37c4d4725630e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47256307 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445837.244361:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6f400, rc 0) 00000100:00100000:1.0:1789445837.244420:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742026752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445837.244427:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789445837.244503:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf761c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742026752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789445837.244521:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d47256307 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725630e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445837.244530:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d47256307 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d4725630e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445837.244616:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742026880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789445837.244648:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445837.244781:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf5e6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789445837.244825:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742026880 00000100:00100000:2.0:1789445837.244831:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742026880 00000100:00100000:2.0:1789445837.244853:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789445837.244860:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742026880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789445837.245218:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742026880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 357us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445837.245226:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789445837.245339:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742026880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789445837.245431:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742027008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789445837.245482:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445837.245520:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf9fbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789445837.245528:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742027008 00000100:00100000:2.0:1789445837.245534:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742027008 00000100:00100000:2.0:1789445837.245562:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789445837.245571:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742027008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789445837.245816:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742027008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445837.245823:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789445837.246157:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742027008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789445837.247742:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:11673:1876369742027136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789445837.248393:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445837.248533:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf5e66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445837.248654:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742027136 00000100:00100000:1.0:1789445837.248773:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742027136 00000100:00100000:1.0:1789445837.248991:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789445837.249005:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:11673:x1876369742027136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789445837.249973:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:11673:x1876369742027136:12345-0@lo:502:llog_process_th.0 Request processed in 965us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445837.249985:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789445837.250140:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:11673:1876369742027136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789445837.250318:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789445837.250330:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789445837.250333:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789445837.250342:0:11673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afe8533d800 00000020:00000080:0.0:1789445837.250345:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789445837.250831:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:11673:1876369742027264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789445837.250895:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445837.250945:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf5e66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445837.250960:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742027264 00000100:00100000:2.0:1789445837.250969:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742027264 00000100:00100000:2.0:1789445837.251029:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789445837.251041:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:11673:x1876369742027264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789445837.251297:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:11673:x1876369742027264:12345-0@lo:502:llog_process_th.0 Request processed in 259us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445837.251304:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789445837.251975:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:11673:1876369742027264:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789445837.252011:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445837.252019:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445837.252022:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789445837.252029:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789445837.252171:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789445837.252196:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789445837.252210:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d47256307 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725630e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445837.252228:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d47256307 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725630e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445837.252239:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789445837.252241:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afe9d560800 from 7 10000000:01000000:2.0:1789445837.252243:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789445837.252275:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445837.252282:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445837.252289:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445837.252305:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf760700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742027392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789445837.252348:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445837.252425:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91474d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789445837.252458:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742027392 00000100:00100000:1.0:1789445837.252464:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742027392 00000100:00100000:1.0:1789445837.252502:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789445837.252517:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:5838:x1876369742027392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789445837.252555:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445837.252573:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe91b6f600/0xc1b37c4d4725631c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47256315 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445837.252609:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe91b6f600/0xc1b37c4d4725631c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47256315 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445837.252624:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe91b6f600/0xc1b37c4d4725631c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47256315 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445837.252635:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6f600, rc 0) 00000100:00100000:1.0:1789445837.252686:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742027392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445837.252705:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789445837.252875:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf760700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742027392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789445837.252890:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725631c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445837.252901:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d4725631c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445837.252989:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf760700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742027520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789445837.253022:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445837.253081:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91474d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789445837.253095:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742027520 00000100:00100000:0.0:1789445837.253102:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742027520 00000100:00100000:0.0:1789445837.253243:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789445837.253254:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742027520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789445837.254500:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742027520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1240us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445837.254514:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789445837.254542:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf760700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742027520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789445837.254635:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf760700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742027648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789445837.254691:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445837.254728:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91474d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789445837.254745:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742027648 00000100:00100000:1.0:1789445837.254753:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742027648 00000100:00100000:1.0:1789445837.254804:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789445837.254813:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742027648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789445837.255284:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf760700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:5838:1876369742027648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789445837.255284:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:5838:x1876369742027648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 470us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445837.255299:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789445837.255998:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:11675:1876369742027776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789445837.256078:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445837.256119:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf9fbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789445837.256187:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742027776 00000100:00100000:2.0:1789445837.256194:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742027776 00000100:00100000:2.0:1789445837.256242:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789445837.256251:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:11675:x1876369742027776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789445837.256544:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:11675:x1876369742027776:12345-0@lo:502:llog_process_th.0 Request processed in 295us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445837.256550:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789445837.256705:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:11675:1876369742027776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789445837.256737:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789445837.256753:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445837.256756:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789445837.256768:0:11675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afe9d560800 00000020:00000080:1.0:1789445837.256770:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789445837.256891:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:11675:1876369742027904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789445837.256931:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445837.256957:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742027904 00000100:00100000:1.0:1789445837.256962:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742027904 00000100:00100000:1.0:1789445837.256982:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789445837.256988:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:11675:x1876369742027904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789445837.257137:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:11675:x1876369742027904:12345-0@lo:502:llog_process_th.0 Request processed in 148us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445837.257144:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789445837.257170:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebf9fbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789445837.257180:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:11675:1876369742027904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789445837.257197:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445837.257201:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445837.257203:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789445837.257207:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000040:00080000:2.0:1789445837.257453:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:2.0:1789445837.257512:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789445837.257532:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789445837.257544:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725631c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445837.257556:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725631c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445837.290222:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445837.297913:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722070400 00000100:00100000:1.0:1789445837.297940:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722070400 00000100:00100000:1.0:1789445837.298270:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 263 00000100:00100000:1.0:1789445837.298286:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+11:5631:x1876369722070400:12345-192.168.206.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789445837.298313:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445837.298341:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe91b6fc00/0xc1b37c4d47256323 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445837.298577:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe91b6fc00/0xc1b37c4d47256323 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b22 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445837.298607:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe91b6fc00/0xc1b37c4d47256323 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b22 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445837.298620:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6fc00, rc 0) 00000100:00100000:1.0:1789445837.298784:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:5631:x1876369722070400:12345-192.168.206.59@tcp:101:ll_cfg_requeue.0 Request processed in 501us (8581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445837.298793:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 263 00000100:00100000:1.0:1789445837.302574:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445837.302966:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722070528 00000100:00100000:0.0:1789445837.302980:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722070528 00000100:00100000:0.0:1789445837.303082:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 264 00000100:00100000:0.0:1789445837.303098:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:5631:x1876369722070528:12345-192.168.206.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789445837.303876:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:5631:x1876369722070528:12345-192.168.206.59@tcp:501:ll_cfg_requeue.0 Request processed in 779us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445837.303887:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 264 00000100:00100000:2.0:1789445837.311290:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445837.311434:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722070656 00000100:00100000:0.0:1789445837.311460:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722070656 00000100:00100000:0.0:1789445837.311547:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 265 00000100:00100000:0.0:1789445837.311560:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:5631:x1876369722070656:12345-192.168.206.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789445837.311930:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:5631:x1876369722070656:12345-192.168.206.59@tcp:503:ll_cfg_requeue.0 Request processed in 370us (4528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445837.311940:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 265 00000100:00100000:0.0:1789445837.324325:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445837.324514:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722070784 00000100:00100000:2.0:1789445837.324531:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722070784 00000100:00100000:2.0:1789445837.324615:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 266 00000100:00100000:2.0:1789445837.324627:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:9998:x1876369722070784:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789445837.325070:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:9998:x1876369722070784:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 415us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445837.325080:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 266 00000100:00100000:2.0:1789445837.328706:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445837.328795:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722070912 00000100:00100000:0.0:1789445837.328810:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722070912 00000100:00100000:0.0:1789445837.328924:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 267 00000100:00100000:0.0:1789445837.328947:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:9998:x1876369722070912:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789445837.329358:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:9998:x1876369722070912:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 422us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445837.329367:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 267 00000100:00100000:0.0:1789445837.333620:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445837.334193:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722071040 00000100:00100000:2.0:1789445837.334215:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722071040 00000100:00100000:2.0:1789445837.334300:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 268 00000100:00100000:2.0:1789445837.334314:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:5631:x1876369722071040:12345-192.168.206.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789445837.334345:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445837.334379:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afeb57bec00/0xc1b37c4d4725632a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b29 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445837.334443:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afeb57bec00/0xc1b37c4d4725632a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b29 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445837.334460:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afeb57bec00/0xc1b37c4d4725632a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b29 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445837.334473:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bec00, rc 0) 00000100:00100000:2.0:1789445837.334582:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:5631:x1876369722071040:12345-192.168.206.59@tcp:101:ll_cfg_requeue.0 Request processed in 269us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445837.334590:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 268 00000100:00100000:1.0:1789445837.337914:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445837.338004:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722071168 00000100:00100000:0.0:1789445837.338018:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722071168 00000100:00100000:0.0:1789445837.338125:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 269 00000100:00100000:0.0:1789445837.338139:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:5631:x1876369722071168:12345-192.168.206.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789445837.338558:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:5631:x1876369722071168:12345-192.168.206.59@tcp:501:ll_cfg_requeue.0 Request processed in 420us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445837.338568:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 269 00000100:00100000:1.0:1789445837.343428:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445837.343539:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722071296 00000100:00100000:2.0:1789445837.343557:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722071296 00000100:00100000:2.0:1789445837.343644:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 270 00000100:00100000:2.0:1789445837.343658:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:5631:x1876369722071296:12345-192.168.206.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789445837.344011:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:5631:x1876369722071296:12345-192.168.206.59@tcp:503:ll_cfg_requeue.0 Request processed in 355us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445837.344020:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 270 00000100:00100000:3.0:1789445837.356189:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445837.356500:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722071424 00000100:00100000:1.0:1789445837.356515:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722071424 00000100:00100000:1.0:1789445837.356608:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 271 00000100:00100000:1.0:1789445837.356622:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:10001:x1876369722071424:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789445837.357019:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:10001:x1876369722071424:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 399us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445837.357029:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 271 00000100:00100000:3.0:1789445837.367363:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445837.368097:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722071552 00000100:00100000:1.0:1789445837.368113:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722071552 00000100:00100000:1.0:1789445837.369553:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 272 00000100:00100000:1.0:1789445837.369577:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:10001:x1876369722071552:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789445837.369945:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:10001:x1876369722071552:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 378us (2597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445837.369961:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 272 00010000:00010000:2.0:1789445837.532022:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445837.916037:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742028416:0@lo:400:kworker.0 00000100:00100000:3.0:1789445837.916041:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369742028160:0@lo:400:kworker.0 00000100:00100000:0.0:1789445837.916161:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742028288:0@lo:400:kworker.0 00000100:00100000:2.0:1789445837.916295:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742028032:0@lo:400:kworker.0 00000100:00100000:1.0:1789445837.916391:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445837.916496:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445837.916499:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742028416 00000100:00100000:1.0:1789445837.916510:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742028416 00000100:00100000:3.0:1789445837.916586:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742028160 00000100:00100000:1.0:1789445837.916604:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789445837.916617:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369742028416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445837.916625:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742028160 00000100:00100000:3.0:1789445837.916663:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789445837.916686:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369742028416:12345-0@lo:400:kworker.0 Request processed in 72us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445837.916693:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1789445837.916718:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445837.916827:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369742028160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445837.916871:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369742028160:12345-0@lo:400:kworker.0 Request processed in 201us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445837.916878:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789445837.916926:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369742028160:0@lo:400:kworker.0 00000100:00100000:3.0:1789445837.917079:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742028416:0@lo:400:kworker.0 00000100:00100000:0.0:1789445837.918078:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445837.918550:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742028288 00000100:00100000:3.0:1789445837.918561:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742028288 00000100:00100000:3.0:1789445837.918647:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789445837.918667:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742028288:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789445837.918918:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb5758700 x1876369742028288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445837.918954:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742028288:0@lo:400:kworker.0 00000100:00080000:1.0:1789445837.919287:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445837.919350:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742028288:12345-0@lo:400:kworker.0 Request processed in 693us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445837.919357:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445837.919359:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789445837.919399:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742028544:0@lo:400:kworker.0 00000100:00100000:2.0:1789445837.919431:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445837.919536:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742028032 00000100:00100000:1.0:1789445837.919543:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742028032 00000100:00100000:1.0:1789445837.919581:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789445837.919598:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742028032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445837.919856:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742028544 00000100:00100000:3.0:1789445837.919861:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742028544 00000100:00100000:1.0:1789445837.919963:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742028032:12345-0@lo:400:kworker.0 Request processed in 374us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445837.919970:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789445837.920096:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742028032:0@lo:400:kworker.0 00000100:00080000:1.0:1789445837.920325:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789445837.920367:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789445837.920798:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1876369742028544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445837.920874:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1876369742028544:12345-0@lo:400:kworker.0 Request processed in 498us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445837.920882:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789445837.921805:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742028544:0@lo:400:kworker.0 00000040:00080000:2.0:1789445838.299475:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789445838.426364:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742028672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789445838.426472:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445838.426811:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742028672 00000100:00100000:1.0:1789445838.426821:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742028672 00000100:00100000:1.0:1789445838.426882:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789445838.426894:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876369742028672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789445838.426941:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445838.427009:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876369742028672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445838.427035:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789445838.427440:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742028672:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789445838.554298:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445839.578692:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445840.602179:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789445840.635489:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:3.0:1789445840.987551:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789445840.987613:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742028800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789445840.987740:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445840.987946:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742028800 00000100:00100000:1.0:1789445840.987968:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742028800 00000100:00100000:1.0:1789445840.988099:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789445840.988112:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742028800:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789445840.988132:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789445840.988165:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445840.988220:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742028800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445840.988227:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1789445840.988870:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf763100 x1876369742028800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445840.988897:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742028800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789445841.443195:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445841.443248:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445841.443284:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445841.443360:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445841.443472:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722071808 00000100:00100000:3.0:1789445841.443485:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722071936 00000100:00100000:3.0:1789445841.443502:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722071936 00000100:00100000:3.0:1789445841.443620:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 58 00000100:00100000:3.0:1789445841.443635:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2374:x1876369722071936:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445841.443743:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2374:x1876369722071936:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 113us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445841.443752:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 58 00000100:00100000:3.0:1789445841.443780:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722072064 00000100:00100000:3.0:1789445841.443784:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722072064 00000100:00100000:0.0:1789445841.443819:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722071808 00000100:00100000:3.0:1789445841.443820:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 101 00000100:00100000:3.0:1789445841.443830:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:338e572d-37d9-47c3-87b6-4735cd889844+5:2374:x1876369722072064:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445841.443862:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:338e572d-37d9-47c3-87b6-4735cd889844+5:2374:x1876369722072064:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 33us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445841.443868:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 101 00000100:00100000:0.0:1789445841.443925:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 102 00000100:00100000:0.0:1789445841.443934:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2374:x1876369722071808:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445841.443969:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2374:x1876369722071808:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 36us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445841.443977:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 102 00000100:00100000:2.0:1789445841.444098:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722071680 00000100:00100000:2.0:1789445841.444105:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722071680 00000100:00100000:2.0:1789445841.444153:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 273 00000100:00100000:2.0:1789445841.444161:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2374:x1876369722071680:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445841.444205:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2374:x1876369722071680:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 45us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445841.444212:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 273 00000100:00080000:1.0:1789445841.445283:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789445841.445295:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789445841.626252:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445842.652454:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445843.035519:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742029056:0@lo:400:kworker.0 00000100:00100000:2.0:1789445843.035642:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445843.035756:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742029568:0@lo:400:kworker.0 00000100:00100000:2.0:1789445843.035789:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445843.035848:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742029312:0@lo:400:kworker.0 00000100:00100000:0.0:1789445843.035888:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445843.035928:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789445843.035935:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369742028928:0@lo:400:kworker.0 00000100:00100000:0.0:1789445843.035968:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445843.035988:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369742029440:0@lo:400:kworker.0 00000100:00100000:0.0:1789445843.036010:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445843.036036:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789445843.036084:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742029056 00000100:00100000:0.0:1789445843.036094:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742029056 00000100:00100000:2.0:1789445843.036100:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742029184:0@lo:400:kworker.0 00000100:00100000:2.0:1789445843.036130:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445843.036177:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742029440 00000100:00100000:2.0:1789445843.036182:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742029440 00000100:00100000:2.0:1789445843.036243:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742029184 00000100:00100000:2.0:1789445843.036247:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742029184 00000100:00100000:2.0:1789445843.036268:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789445843.036278:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876369742029440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445843.036345:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876369742029440:12345-0@lo:400:kworker.0 Request processed in 68us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445843.036353:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789445843.036373:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789445843.036379:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742029184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445843.036408:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742029184:12345-0@lo:400:kworker.0 Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445843.036414:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789445843.036458:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742029184:0@lo:400:kworker.0 00000100:00100000:0.0:1789445843.036619:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789445843.036635:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742029056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445843.036675:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742029056:12345-0@lo:400:kworker.0 Request processed in 41us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445843.036682:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789445843.036728:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369742029440:0@lo:400:kworker.0 00000100:00100000:3.0:1789445843.038039:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742029568 00000100:00100000:3.0:1789445843.038096:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742029568 00000100:00100000:3.0:1789445843.038159:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742029312 00000100:00100000:3.0:1789445843.038162:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742029312 00000100:00100000:3.0:1789445843.038188:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789445843.038210:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742029568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445843.038295:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742029568:12345-0@lo:400:kworker.0 Request processed in 99us (2505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445843.038319:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789445843.038333:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789445843.038339:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742029312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445843.038385:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742029312:12345-0@lo:400:kworker.0 Request processed in 46us (2497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445843.038391:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1789445843.038445:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeba5ced80 x1876369742029312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445843.038461:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742029312:0@lo:400:kworker.0 00000100:00100000:2.0:1789445843.038595:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742029056:0@lo:400:kworker.0 00000100:00100000:2.0:1789445843.038606:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1789445843.038611:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afeb5c78700, transno 4294967300 00000100:00100000:2.0:1789445843.038630:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742029568:0@lo:400:kworker.0 00000100:00100000:1.0:1789445843.039694:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742028928 00000100:00100000:1.0:1789445843.039727:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742028928 00000100:00080000:0.0:1789445843.039760:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789445843.039767:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789445843.039771:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789445843.039791:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789445843.039802:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3310:x1876369742028928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445843.039893:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3310:x1876369742028928:12345-0@lo:400:kworker.0 Request processed in 95us (3924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445843.039900:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789445843.040187:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369742028928:0@lo:400:kworker.0 00000100:00100000:2.0:1789445843.546364:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789445843.546398:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742029696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789445843.546502:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445843.546713:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742029696 00000100:00100000:1.0:1789445843.546725:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742029696 00000100:00100000:1.0:1789445843.546792:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789445843.546825:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742029696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789445843.546881:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445843.546944:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742029696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445843.548666:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789445843.550486:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742029696:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789445843.674255:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445844.698273:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445845.723160:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445846.109027:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742029824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789445846.109172:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445846.109366:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742029824 00000100:00100000:0.0:1789445846.109379:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742029824 00000100:00100000:0.0:1789445846.109467:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789445846.109479:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5758700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742029824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789445846.109529:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789445846.109600:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5758700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742029824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445846.109607:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1789445846.109748:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4d42680 x1876369742029824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445846.109769:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742029824:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789445846.109880:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789445846.575241:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445846.575288:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445846.575328:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445846.575368:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445846.575414:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722072320 00000100:00100000:0.0:1789445846.575427:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722072320 00000100:00100000:0.0:1789445846.575513:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722072576 00000100:00100000:0.0:1789445846.575773:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722072576 00000100:00100000:0.0:1789445846.575930:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 106 00000100:00100000:0.0:1789445846.575943:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2375:x1876369722072320:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445846.576127:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 107 00000100:00100000:1.0:1789445846.576140:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:338e572d-37d9-47c3-87b6-4735cd889844+5:2375:x1876369722072576:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445846.576191:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:338e572d-37d9-47c3-87b6-4735cd889844+5:2375:x1876369722072576:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 55us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445846.576199:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 107 00000100:00100000:0.0:1789445846.576260:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2375:x1876369722072320:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 318us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445846.576276:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 106 00000100:00100000:0.0:1789445846.576310:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722072192 00000100:00100000:0.0:1789445846.576315:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722072192 00000100:00100000:0.0:1789445846.576347:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 275 00000100:00100000:0.0:1789445846.576356:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2375:x1876369722072192:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445846.576386:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2375:x1876369722072192:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 32us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445846.576393:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 275 00000100:00100000:0.0:1789445846.576427:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722072448 00000100:00100000:0.0:1789445846.576431:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722072448 00000100:00100000:0.0:1789445846.576466:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 61 00000100:00100000:0.0:1789445846.576486:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2375:x1876369722072448:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445846.576529:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2375:x1876369722072448:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 44us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445846.576535:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 61 00000100:00080000:0.0:1789445846.576563:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789445846.576568:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789445846.746377:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445847.770263:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445848.154829:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742029952:0@lo:400:kworker.0 00000100:00100000:1.0:1789445848.154945:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445848.155096:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742029952 00000100:00100000:2.0:1789445848.155110:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742029952 00000100:00100000:2.0:1789445848.155175:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789445848.155186:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742029952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445848.155437:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369742030208:0@lo:400:kworker.0 00000100:00100000:0.0:1789445848.155479:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445848.155517:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789445848.155524:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876369742030080:0@lo:400:kworker.0 00000100:00100000:0.0:1789445848.155559:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445848.155587:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742030208 00000100:00100000:0.0:1789445848.155590:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742030208 00000100:00100000:0.0:1789445848.155627:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742030080 00000100:00100000:0.0:1789445848.155629:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742030080 00000100:00100000:0.0:1789445848.155665:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789445848.155671:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369742030208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445848.155713:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369742030208:12345-0@lo:400:kworker.0 Request processed in 41us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445848.155720:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789445848.155739:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789445848.155746:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876369742030080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445848.155772:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876369742030080:12345-0@lo:400:kworker.0 Request processed in 28us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445848.155778:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1789445848.155799:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789445848.155842:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876369742030080:0@lo:400:kworker.0 00000100:00100000:0.0:1789445848.155854:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369742030208:0@lo:400:kworker.0 00000100:00100000:0.0:1789445848.155930:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742030336:0@lo:400:kworker.0 00000100:00100000:0.0:1789445848.155963:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445848.155996:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742030336 00000100:00100000:0.0:1789445848.156000:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742030336 00000100:00100000:0.0:1789445848.156035:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789445848.156042:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742030336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445848.156112:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742030336:12345-0@lo:400:kworker.0 Request processed in 71us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445848.156119:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1789445848.156139:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789445848.156160:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb5c78700 x1876369742030336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445848.156186:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742030336:0@lo:400:kworker.0 00000100:00100000:2.0:1789445848.165200:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742029952:12345-0@lo:400:kworker.0 Request processed in 10001us (10239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445848.165215:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742029952:0@lo:400:kworker.0 00000100:00100000:2.0:1789445848.165223:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789445848.167595:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742030464:0@lo:400:kworker.0 00000100:00100000:1.0:1789445848.167700:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445848.167837:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742030592:0@lo:400:kworker.0 00000100:00100000:3.0:1789445848.167877:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445848.167927:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742030592 00000100:00100000:3.0:1789445848.167936:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742030592 00000100:00100000:3.0:1789445848.168004:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789445848.168015:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742030592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445848.168105:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742030592:12345-0@lo:400:kworker.0 Request processed in 92us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445848.168133:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789445848.168181:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742030592:0@lo:400:kworker.0 00000100:00080000:3.0:1789445848.168205:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789445848.168319:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742030464 00000100:00100000:0.0:1789445848.168324:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742030464 00000100:00100000:0.0:1789445848.168377:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789445848.168385:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369742030464:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789445848.169690:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789445848.169941:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369742030464:12345-0@lo:400:kworker.0 Request processed in 1551us (2234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445848.169953:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789445848.170109:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742030464:0@lo:400:kworker.0 00000040:00080000:2.0:1789445848.540536:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789445848.666618:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789445848.666651:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742030720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789445848.666757:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445848.666912:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742030720 00000100:00100000:2.0:1789445848.666923:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742030720 00000100:00100000:2.0:1789445848.666985:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789445848.666996:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742030720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789445848.667041:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789445848.667120:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742030720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445848.667128:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789445848.667251:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742030720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789445848.795209:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445849.818271:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445850.843739:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445851.226646:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789445851.228601:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742030848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789445851.228741:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445851.229285:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742030848 00000100:00100000:2.0:1789445851.229298:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742030848 00000100:00100000:2.0:1789445851.229437:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789445851.229451:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742030848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789445851.229502:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789445851.229598:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742030848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445851.229606:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1789445851.229684:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789445851.229810:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afea4d43800 x1876369742030848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445851.229836:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742030848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789445851.682734:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445851.682797:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445851.682948:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722072704 00000100:00100000:0.0:1789445851.682961:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722072704 00000100:00100000:0.0:1789445851.683036:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 277 00000100:00100000:0.0:1789445851.683099:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2374:x1876369722072704:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445851.684276:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2374:x1876369722072704:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 1221us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445851.684292:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 277 00000100:00100000:2.0:1789445851.685248:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722072832 00000100:00100000:2.0:1789445851.685265:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722072832 00000100:00100000:2.0:1789445851.685963:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 111 00000100:00100000:2.0:1789445851.685981:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2374:x1876369722072832:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445851.686124:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2374:x1876369722072832:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 148us (3325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445851.686133:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 111 00000100:00080000:3.0:1789445851.686962:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789445851.695072:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445851.695206:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445851.695322:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722072960 00000100:00100000:0.0:1789445851.695443:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722072960 00000100:00100000:2.0:1789445851.695569:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722073088 00000100:00100000:2.0:1789445851.695574:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722073088 00000100:00100000:1.0:1789445851.695629:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 19 00000100:00100000:1.0:1789445851.695644:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2373:x1876369722072960:12345-192.168.206.59@tcp:9:kworker.0 00000020:00000080:1.0:1789445851.695694:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47256266 00000100:00080000:1.0:1789445851.695706:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9afeba5ba000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789445851.695760:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1789445851.696199:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789445851.696210:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00010000:0.0:1789445851.696462:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445851.697835:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+2:2373:x1876369722072960:12345-192.168.206.59@tcp:9:kworker.0 Request processed in 2184us (2895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445851.697853:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 19 00000100:00080000:3.0:1789445851.699547:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789445851.699561:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789445851.699885:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 112 00000100:00100000:2.0:1789445851.699912:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2374:x1876369722073088:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445851.700072:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2374:x1876369722073088:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 165us (4865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445851.700080:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 112 00010000:00010000:2.0:1789445851.866563:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445852.890425:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445853.274367:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742030976:0@lo:400:kworker.0 00000100:00100000:0.0:1789445853.274491:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445853.274761:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742030976 00000100:00100000:1.0:1789445853.274772:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742030976 00000100:00100000:1.0:1789445853.274853:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789445853.274864:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742030976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445853.275084:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742031104:0@lo:400:kworker.0 00000100:00100000:2.0:1789445853.275124:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445853.275152:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789445853.275157:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742031232:0@lo:400:kworker.0 00000100:00100000:2.0:1789445853.275176:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445853.275204:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742031104 00000100:00100000:2.0:1789445853.275208:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742031104 00000100:00100000:2.0:1789445853.275246:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742031232 00000100:00100000:2.0:1789445853.275249:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742031232 00000100:00100000:2.0:1789445853.275280:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789445853.275287:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742031104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445853.275326:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742031104:12345-0@lo:400:kworker.0 Request processed in 39us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445853.275335:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789445853.275354:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789445853.275361:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742031232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445853.275385:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742031232:12345-0@lo:400:kworker.0 Request processed in 25us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445853.275390:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789445853.275430:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742031232:0@lo:400:kworker.0 00000100:00100000:2.0:1789445853.275458:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742031104:0@lo:400:kworker.0 00000100:00080000:2.0:1789445853.275512:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445853.275549:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742031360:0@lo:400:kworker.0 00000100:00100000:2.0:1789445853.275583:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445853.275621:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742031360 00000100:00100000:2.0:1789445853.275624:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742031360 00000100:00100000:2.0:1789445853.275659:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789445853.275666:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742031360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445853.275704:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742031360:12345-0@lo:400:kworker.0 Request processed in 39us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445853.275710:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1789445853.275725:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789445853.275744:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afe9192df80 x1876369742031360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445853.275764:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742031360:0@lo:400:kworker.0 00000100:00100000:3.0:1789445853.278294:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789445853.278319:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742031616:0@lo:400:kworker.0 00000100:00100000:3.0:1789445853.278396:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445853.278474:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742031616 00000100:00100000:3.0:1789445853.278482:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742031616 00000100:00080000:3.0:1789445853.278513:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789445853.278579:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789445853.278591:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742031616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445853.278664:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742031616:12345-0@lo:400:kworker.0 Request processed in 75us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445853.278672:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789445853.278716:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742031616:0@lo:400:kworker.0 00000100:00100000:2.0:1789445853.281608:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789445853.281649:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369742031488:0@lo:400:kworker.0 00000100:00100000:2.0:1789445853.281835:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445853.284964:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742031488 00000100:00100000:3.0:1789445853.284986:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742031488 00000100:00100000:3.0:1789445853.285119:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789445853.285131:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876369742031488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445853.285260:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876369742031488:12345-0@lo:400:kworker.0 Request processed in 132us (3426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445853.285269:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1789445853.285944:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445853.286010:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369742031488:0@lo:400:kworker.0 00000100:00100000:0.0:1789445853.289213:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742030976:0@lo:400:kworker.0 00000100:00100000:1.0:1789445853.293135:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742030976:12345-0@lo:400:kworker.0 Request processed in 18254us (18624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445853.293211:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789445853.788152:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789445853.788185:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742031744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789445853.788295:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445853.791272:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742031744 00000100:00100000:1.0:1789445853.791296:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742031744 00000100:00100000:1.0:1789445853.791394:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789445853.791407:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742031744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789445853.791457:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445853.791600:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742031744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 196us (3305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445853.791628:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789445853.796439:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742031744:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789445853.915087:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445854.938259:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789445855.873770:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4a94602d-5f10-4cb2-abf8-c0de02603d85 00000020:00000080:0.0:1789445855.873780:0:7638:0:(genops.c:885:class_export_put()) final put ffff9afeba5bd000/4a94602d-5f10-4cb2-abf8-c0de02603d85 00000020:00000080:2.0:1789445855.873870:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9afeba5bd000/4a94602d-5f10-4cb2-abf8-c0de02603d85 for lustre-OST0001 00000020:00000080:2.0:1789445855.875636:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afeba5ba000 for lustre-OST0001 00010000:00010000:2.0:1789445855.963394:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445856.355124:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742031872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789445856.355219:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445856.355271:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742031872 00000100:00100000:1.0:1789445856.355280:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742031872 00000100:00100000:1.0:1789445856.355341:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789445856.355351:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742031872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789445856.355387:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445856.355435:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742031872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445856.355443:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1789445856.355520:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789445856.355555:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeba5cd180 x1876369742031872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445856.355573:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742031872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789445856.805651:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445856.805757:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722073216 00000100:00100000:0.0:1789445856.805768:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722073216 00000100:00100000:0.0:1789445856.805836:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 279 00000100:00100000:0.0:1789445856.805847:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4f08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2377:x1876369722073216:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445856.805920:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4f08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2377:x1876369722073216:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 75us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445856.805928:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 279 00000100:00100000:1.0:1789445856.814723:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445856.814894:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445856.827596:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722073472 00000100:00100000:2.0:1789445856.827612:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722073472 00000100:00100000:2.0:1789445856.827692:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722073344 00000100:00100000:2.0:1789445856.827696:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722073344 00000100:00100000:2.0:1789445856.827724:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 116 00000100:00100000:2.0:1789445856.827733:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2377:x1876369722073472:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445856.827835:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2377:x1876369722073472:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 102us (13119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445856.827844:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 116 00000100:00100000:2.0:1789445856.827863:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 117 00000100:00100000:2.0:1789445856.827870:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2377:x1876369722073344:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445856.827909:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2377:x1876369722073344:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 40us (13016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445856.827915:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 117 00000100:00080000:0.0:1789445856.828923:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789445856.989566:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445858.016370:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445858.394821:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742032000:0@lo:400:kworker.0 00000100:00100000:1.0:1789445858.394997:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445858.395267:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742032384:0@lo:400:kworker.0 00000100:00100000:3.0:1789445858.395315:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445858.395362:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742032128:0@lo:400:kworker.0 00000100:00100000:3.0:1789445858.395392:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445858.395414:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789445858.395420:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742032256:0@lo:400:kworker.0 00000100:00100000:3.0:1789445858.395466:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445858.395521:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742032384 00000100:00100000:3.0:1789445858.395531:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742032384 00000100:00100000:3.0:1789445858.395606:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789445858.395618:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742032384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445858.395679:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742032384:12345-0@lo:400:kworker.0 Request processed in 63us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445858.395692:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789445858.395722:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742032128 00000100:00100000:3.0:1789445858.395726:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742032128 00000100:00100000:3.0:1789445858.395751:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742032256 00000100:00100000:3.0:1789445858.395754:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742032256 00000100:00100000:3.0:1789445858.395791:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789445858.395798:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742032128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445858.395832:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742032128:12345-0@lo:400:kworker.0 Request processed in 35us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445858.395839:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789445858.395850:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789445858.395856:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742032256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445858.395906:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742032256:12345-0@lo:400:kworker.0 Request processed in 51us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445858.395912:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1789445858.395933:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789445858.395938:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789445858.395976:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeb9e45f80 x1876369742032384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445858.395992:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742032384:0@lo:400:kworker.0 00000100:00100000:3.0:1789445858.396029:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742032256:0@lo:400:kworker.0 00000100:00100000:3.0:1789445858.396039:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742032128:0@lo:400:kworker.0 00000100:00100000:2.0:1789445858.396437:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742032000 00000100:00100000:2.0:1789445858.396443:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742032000 00000100:00100000:2.0:1789445858.396476:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789445858.396484:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742032000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445858.397180:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789445858.397204:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742032640:0@lo:400:kworker.0 00000100:00100000:0.0:1789445858.397248:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445858.397486:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742032000:12345-0@lo:400:kworker.0 Request processed in 1001us (2488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445858.397514:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789445858.397893:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742032640 00000100:00100000:3.0:1789445858.397903:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742032640 00000100:00100000:3.0:1789445858.397971:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789445858.397981:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742032640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445858.398340:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742032640:12345-0@lo:400:kworker.0 Request processed in 349us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445858.398358:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789445858.398490:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742032640:0@lo:400:kworker.0 00000100:00080000:0.0:1789445858.399219:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789445858.399391:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789445858.399973:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742032000:0@lo:400:kworker.0 00000100:00100000:3.0:1789445858.400536:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369742032512:0@lo:400:kworker.0 00000100:00100000:3.0:1789445858.400608:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445858.400704:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742032512 00000100:00100000:2.0:1789445858.400716:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742032512 00000100:00100000:2.0:1789445858.400808:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789445858.400819:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876369742032512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445858.400921:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876369742032512:12345-0@lo:400:kworker.0 Request processed in 105us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445858.400929:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1789445858.401193:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445858.401237:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369742032512:0@lo:400:kworker.0 00000040:00080000:3.0:1789445858.779177:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789445858.906320:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742032768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789445858.906403:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445858.906557:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742032768 00000100:00100000:1.0:1789445858.906566:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742032768 00000100:00100000:1.0:1789445858.906616:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789445858.906626:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742032768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789445858.906661:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445858.906710:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742032768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445858.906730:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789445858.906831:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742032768:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789445859.034197:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445860.064962:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789445860.241722:0:11841:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 00:17:38 (1789445858) 00010000:00010000:0.0:1789445861.082387:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445861.466907:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789445861.466940:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742032896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789445861.467090:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445861.467663:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742032896 00000100:00100000:1.0:1789445861.467674:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742032896 00000100:00100000:1.0:1789445861.467780:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789445861.467792:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742032896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789445861.467847:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445861.467918:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742032896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445861.467925:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1789445861.468024:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789445861.468184:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeba5cc000 x1876369742032896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789445877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445861.468220:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742032896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789445861.837275:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445861.844180:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722073600 00000100:00100000:0.0:1789445861.844199:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722073600 00000100:00100000:0.0:1789445861.844634:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 32 00000100:00100000:0.0:1789445861.844650:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:10270:x1876369722073600:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789445861.844678:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445861.844707:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256331 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b30 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445861.844805:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d47256338 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445861.844821:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d47256338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445861.844835:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d47256338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445861.844879:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789445861.844883:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789445861.844929:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d47256338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445861.844956:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256331 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b30 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445861.844976:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d47256338 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b30 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445861.844985:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961300) 00010000:00010000:0.0:1789445861.845002:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789445861.845007:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907400, rc 0) 00000100:00100000:0.0:1789445861.845139:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:10270:x1876369722073600:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 494us (7878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445861.845147:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 32 00000100:00080000:3.0:1789445861.846942:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789445861.852645:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445861.852781:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722073728 00000100:00100000:2.0:1789445861.852795:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722073728 00000100:00100000:2.0:1789445861.852863:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 33 00000100:00100000:2.0:1789445861.852875:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:10271:x1876369722073728:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789445861.852903:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445861.856499:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d4725633f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.856663:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256346 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.856679:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256346 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.856693:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256346 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.856712:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d4725634d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.856720:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d4725634d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.856727:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d4725634d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857245:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be000/0xc1b37c4d47256354 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857279:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be000/0xc1b37c4d47256354 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857288:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be000/0xc1b37c4d47256354 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445861.857318:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789445861.857322:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789445861.857344:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be000/0xc1b37c4d47256354 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857355:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256346 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857362:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256346 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857369:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256346 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857375:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445861.857379:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256346 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857387:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256346 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857398:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961300) 00010000:00010000:2.0:1789445861.857401:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445861.857406:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256346 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857423:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256346 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857437:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d4725634d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857444:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d4725634d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857450:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d4725634d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857456:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445861.857459:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d4725634d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857466:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d4725634d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857483:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9afe90eac300) 00010000:00010000:2.0:1789445861.857486:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445861.857489:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d4725634d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857495:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d4725634d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857538:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d4725633f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b37 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857553:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be000/0xc1b37c4d47256354 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b37 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445861.857567:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9afe90eacc00) 00010000:00010000:2.0:1789445861.857570:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789445861.857573:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57be000, rc 0) 00000100:00100000:2.0:1789445861.857654:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:10271:x1876369722073728:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 4780us (5023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445861.857663:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 33 00000100:00100000:1.0:1789445861.865014:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445861.865113:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722073984 00000100:00100000:0.0:1789445861.865131:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722073984 00000100:00100000:1.0:1789445861.865375:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 34 00000100:00100000:1.0:1789445861.865390:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:10271:x1876369722073984:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789445861.865417:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445861.865444:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725635b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b3e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.865551:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256362 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.865570:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256362 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.865584:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256362 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.865612:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256369 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.865619:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256369 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.865626:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256369 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.866294:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e400/0xc1b37c4d47256370 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.866307:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e400/0xc1b37c4d47256370 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.866315:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e400/0xc1b37c4d47256370 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445861.866327:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789445861.866764:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256362 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.867026:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256362 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.867035:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256362 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.867041:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445861.867080:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256362 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.867089:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256362 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.867108:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9afe90eacc00) 00010000:00010000:1.0:1789445861.867112:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445861.867118:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256362 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.867140:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256362 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.867157:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256369 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.867164:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256369 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.867176:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256369 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.867181:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6ee00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445861.867185:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256369 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.867191:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256369 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.867199:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9afe858f5700) 00010000:00010000:1.0:1789445861.867202:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445861.867205:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256369 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.867210:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256369 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.876199:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725635b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b3e expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.876227:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e400/0xc1b37c4d47256370 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b3e expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445861.876244:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afe858f5c00) 00010000:00010000:1.0:1789445861.876247:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445861.876251:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6e400, rc 0) 00000100:00100000:1.0:1789445861.876332:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:10271:x1876369722073984:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 10944us (11326us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789445861.876341:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 34 00000100:00100000:3.0:1789445861.887906:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445861.887999:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722074112 00000100:00100000:1.0:1789445861.888013:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722074112 00000100:00100000:1.0:1789445861.888131:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 35 00000100:00100000:1.0:1789445861.888143:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:10271:x1876369722074112:12345-192.168.206.59@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789445861.888249:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:10271:x1876369722074112:12345-192.168.206.59@tcp:59:lhsmtool_posix.0 Request processed in 107us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445861.888258:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 35 00000100:00100000:0.0:1789445861.922403:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445861.922458:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445861.922616:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722074240 00000100:00100000:2.0:1789445861.922637:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722074240 00000100:00100000:2.0:1789445861.922707:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 281 00000100:00100000:2.0:1789445861.922720:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2375:x1876369722074240:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445861.922827:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2375:x1876369722074240:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 110us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445861.922835:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 281 00000100:00100000:1.0:1789445861.923290:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722074368 00000100:00100000:1.0:1789445861.923296:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722074368 00000100:00100000:1.0:1789445861.923368:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 121 00000100:00100000:1.0:1789445861.923377:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:338e572d-37d9-47c3-87b6-4735cd889844+5:2375:x1876369722074368:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445861.923437:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:338e572d-37d9-47c3-87b6-4735cd889844+5:2375:x1876369722074368:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 60us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445861.923444:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 121 00000100:00080000:3.0:1789445861.923751:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789445862.109542:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789445862.879572:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789445863.134947:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445863.514417:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742033152:0@lo:400:kworker.0 00000100:00100000:2.0:1789445863.514532:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445863.514584:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742033664:0@lo:400:kworker.0 00000100:00100000:2.0:1789445863.514608:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445863.514641:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789445863.514648:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742033280:0@lo:400:kworker.0 00000100:00100000:2.0:1789445863.514672:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445863.514711:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742033152 00000100:00100000:2.0:1789445863.514719:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742033152 00000100:00100000:2.0:1789445863.514775:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742033280 00000100:00100000:2.0:1789445863.514780:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742033280 00000100:00100000:2.0:1789445863.514815:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789445863.514825:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742033152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445863.514876:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742033152:12345-0@lo:400:kworker.0 Request processed in 53us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445863.514883:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789445863.514901:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789445863.514907:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742033280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445863.514934:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742033280:12345-0@lo:400:kworker.0 Request processed in 27us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445863.514940:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789445863.514957:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742033664 00000100:00100000:2.0:1789445863.514961:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742033664 00000100:00100000:2.0:1789445863.515010:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789445863.515018:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742033664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445863.515084:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742033664:12345-0@lo:400:kworker.0 Request processed in 68us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445863.515090:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1789445863.515111:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789445863.515115:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445863.515263:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742033280:0@lo:400:kworker.0 00000100:00100000:2.0:1789445863.515275:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742033152:0@lo:400:kworker.0 00000100:00100000:2.0:1789445863.515285:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742033664:0@lo:400:kworker.0 00000100:00100000:0.0:1789445863.515397:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742033024:0@lo:400:kworker.0 00000100:00100000:0.0:1789445863.515431:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445863.515466:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742033536:0@lo:400:kworker.0 00000100:00100000:3.0:1789445863.515494:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742033024 00000100:00100000:3.0:1789445863.515501:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742033024 00000100:00100000:0.0:1789445863.515506:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445863.515532:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789445863.515536:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789445863.515540:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742033408:0@lo:400:kworker.0 00000100:00100000:3.0:1789445863.515549:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742033024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445863.515567:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445863.515600:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742033024:12345-0@lo:400:kworker.0 Request processed in 53us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445863.515604:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742033024:0@lo:400:kworker.0 00000100:00100000:3.0:1789445863.515611:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789445863.515633:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742033408 00000100:00100000:0.0:1789445863.515638:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742033408 00000100:00080000:3.0:1789445863.515681:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789445863.515692:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789445863.515700:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742033408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445863.515746:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742033408:12345-0@lo:400:kworker.0 Request processed in 48us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445863.515753:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1789445863.515787:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebf614e00 x1876369742033408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789445879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445863.515789:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742033536 00000100:00100000:0.0:1789445863.515795:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742033536 00000100:00100000:3.0:1789445863.515814:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742033408:0@lo:400:kworker.0 00000100:00100000:0.0:1789445863.515835:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789445863.515843:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369742033536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445863.515885:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369742033536:12345-0@lo:400:kworker.0 Request processed in 42us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445863.515891:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1789445863.515907:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445863.515990:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742033536:0@lo:400:kworker.0 00000100:00100000:1.0:1789445863.843320:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445863.843539:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722074496 00000100:00100000:3.0:1789445863.843549:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722074496 00000100:00100000:3.0:1789445863.843615:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 36 00000100:00100000:3.0:1789445863.843625:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:10314:x1876369722074496:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445863.843643:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445863.843703:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d4725637e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b45 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.843766:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256385 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.843796:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256385 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.843807:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256385 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.843822:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725638c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.843829:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725638c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.843836:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725638c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.844003:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256385 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.844010:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256385 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.844017:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256385 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.844023:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445863.844028:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256385 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.844036:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256385 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.844072:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961300) 00010000:00010000:3.0:1789445863.844081:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445863.844088:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256385 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.844094:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256385 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.844106:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725638c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.844112:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725638c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.844118:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725638c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.844123:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fd200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445863.844126:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725638c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.844132:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725638c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.844139:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9afe8e97a500) 00010000:00010000:3.0:1789445863.844142:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445863.844145:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725638c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.844150:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725638c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.844179:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d4725637e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b45 expref: 10 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.844199:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961300) 00010000:00010000:3.0:1789445863.844202:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445863.844206:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d4725637e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b45 expref: 10 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.844215:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fc200, rc 0) 00000100:00100000:3.0:1789445863.844267:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:10314:x1876369722074496:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 644us (955us total) trans 0 rc 301/301 00000100:00100000:3.0:1789445863.844274:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 36 00000100:00080000:1.0:1789445863.844508:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789445863.857349:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445863.857426:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722074752 00000100:00100000:1.0:1789445863.857435:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722074752 00000100:00100000:1.0:1789445863.857509:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 37 00000100:00100000:1.0:1789445863.857519:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:10314:x1876369722074752:12345-192.168.206.59@tcp:36:lfs.0 00010000:00010000:1.0:1789445863.857571:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445863.857595:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d47256338 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b30 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445863.857612:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961300) 00010000:00010000:1.0:1789445863.857622:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789445863.857819:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256393 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445863.857833:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256393 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445863.857843:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256393 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445863.857854:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d4725639a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445863.857861:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d4725639a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445863.857867:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d4725639a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445863.858765:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789445863.858777:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256393 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445863.858785:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256393 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445863.858798:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256393 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445863.858804:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6f800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445863.858809:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256393 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445863.858816:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256393 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445863.858827:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:1.0:1789445863.858831:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445863.858835:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256393 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445863.858841:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256393 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789445863.858857:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007bbb9305 reply state 000000000620a51a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d4725639a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445863.858867:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789445863.858972:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+10:10314:x1876369722074752:12345-192.168.206.59@tcp:36:lfs.0 Request processed in 1452us (1629us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789445863.858980:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 37 00010000:00010000:3.0:1789445863.867498:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d4725639a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.867515:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d4725639a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.867523:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d4725639a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.867529:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445863.867533:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d4725639a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.867540:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d4725639a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.867556:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9afe858f5600) 00010000:00010000:3.0:1789445863.867559:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445863.867565:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d4725639a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445863.867584:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d4725639a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445864.004615:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445864.007212:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722074880 00000100:00100000:2.0:1789445864.007227:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722074880 00000100:00100000:3.0:1789445864.011241:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 38 00000100:00100000:3.0:1789445864.011256:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:10322:x1876369722074880:12345-192.168.206.59@tcp:101:lctl.0 00010000:00010000:3.0:1789445864.011292:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445864.011313:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472563a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b4c expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.011371:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d472563a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.011384:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d472563a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.011397:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d472563a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445864.011430:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789445864.011434:0:8204:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789445864.011482:0:8204:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d472563a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.011506:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472563a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b4c expref: 11 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.011525:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d472563a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b4c expref: 10 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.011550:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe8e97a500) 00010000:00010000:3.0:1789445864.011553:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789445864.011556:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fc200, rc 0) 00000100:00100000:3.0:1789445864.011626:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+10:10322:x1876369722074880:12345-192.168.206.59@tcp:101:lctl.0 Request processed in 373us (7020us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445864.011633:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 38 00000100:00100000:0.0:1789445864.026400:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789445864.033406:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742033792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789445864.033495:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445864.037367:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742033792 00000100:00100000:3.0:1789445864.037383:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742033792 00000100:00100000:3.0:1789445864.037528:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789445864.037540:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742033792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789445864.037581:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789445864.037676:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742033792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (4181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445864.037684:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789445864.037780:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742033792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789445864.105290:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445864.105537:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722075008 00000100:00100000:1.0:1789445864.105548:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722075008 00000100:00100000:1.0:1789445864.105624:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 39 00000100:00100000:1.0:1789445864.105635:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+10:10328:x1876369722075008:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:1.0:1789445864.105653:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445864.105674:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d472563af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b53 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.105734:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472563b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.105749:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472563b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.105760:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472563b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.105773:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472563bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.105780:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472563bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.105786:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472563bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.105886:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ea00/0xc1b37c4d472563c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.105893:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ea00/0xc1b37c4d472563c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.105899:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ea00/0xc1b37c4d472563c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445864.105934:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789445864.105937:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789445864.105975:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ea00/0xc1b37c4d472563c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.105986:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472563b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.105992:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472563b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.105999:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472563b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.106004:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445864.106008:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472563b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.106015:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472563b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.106026:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe8e97a500) 00010000:00010000:1.0:1789445864.106029:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445864.106034:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472563b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.106039:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472563b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.106094:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472563bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.106110:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472563bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.106115:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472563bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.106120:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445864.106123:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472563bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.106129:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472563bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.106136:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9afe858f5700) 00010000:00010000:1.0:1789445864.106139:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445864.106142:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472563bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.106148:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472563bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.106177:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d472563af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b53 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.106191:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ea00/0xc1b37c4d472563c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b53 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.106197:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:1.0:1789445864.106200:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789445864.106208:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6ea00, rc 0) 00000100:00100000:1.0:1789445864.106269:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+11:10328:x1876369722075008:12345-192.168.206.59@tcp:101:bash.0 Request processed in 636us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445864.106276:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 39 00000100:00100000:1.0:1789445864.118189:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445864.118272:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722075264 00000100:00100000:2.0:1789445864.118282:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722075264 00000100:00100000:2.0:1789445864.118343:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 40 00000100:00100000:2.0:1789445864.118354:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+11:10328:x1876369722075264:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:2.0:1789445864.118373:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445864.118392:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d472563cb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b5a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.118524:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472563d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.118538:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472563d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.118550:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472563d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.118599:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472563d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.118607:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472563d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.118614:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472563d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789445864.119535:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789445864.119711:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d472563e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.120000:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d472563e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.120011:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d472563e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.120155:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472563d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.120163:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472563d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.120170:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472563d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.120175:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bee00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445864.120179:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472563d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.120186:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472563d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.120197:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:2.0:1789445864.120201:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445864.120206:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472563d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.120212:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472563d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789445864.120226:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce8e9db6 reply state 00000000fa82fe01 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472563d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445864.120241:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789445864.120290:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d472563cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b5a expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.120306:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d472563e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b5a expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.120313:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe90eac500) 00010000:00010000:2.0:1789445864.120315:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789445864.120318:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bfc00, rc 0) 00000100:00100000:2.0:1789445864.120380:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:10328:x1876369722075264:12345-192.168.206.59@tcp:101:bash.0 Request processed in 2028us (2199us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789445864.120387:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 40 00000100:00100000:3.0:1789445864.125151:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445864.125302:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722075392 00000100:00100000:2.0:1789445864.125311:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722075392 00000100:00100000:2.0:1789445864.125354:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 20 00000100:00100000:2.0:1789445864.125362:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2373:x1876369722075392:12345-192.168.206.59@tcp:8:bash.0 00010000:00080000:2.0:1789445864.125393:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:2.0:1789445864.125423:0:6684:0:(genops.c:1384:class_connect()) connect: client 4a94602d-5f10-4cb2-abf8-c0de02603d85, cookie 0xc1b37c4d472563ee 00002000:00100000:2.0:1789445864.125443:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4a94602d-5f10-4cb2-abf8-c0de02603d85/ffff9afe91e44800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789445864.125475:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789445864.125701:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789445864.125732:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9afe91e40000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789445864.125796:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2373:x1876369722075392:12345-192.168.206.59@tcp:8:bash.0 Request processed in 433us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445864.125830:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 20 00010000:00010000:1.0:1789445864.126422:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472563d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.126443:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472563d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.126450:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472563d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.126456:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445864.126460:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472563d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.126477:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472563d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.126492:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe90eac300) 00010000:00010000:1.0:1789445864.126494:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445864.126499:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472563d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.126504:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472563d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445864.139160:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445864.139422:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722075520 00000100:00100000:2.0:1789445864.139431:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722075520 00000100:00100000:2.0:1789445864.139591:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 21 00000100:00100000:2.0:1789445864.139600:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:0:x1876369722075520:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:2.0:1789445864.139616:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445864.139636:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b6e226e/0xc1b37c4d472563f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b61 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789445864.139687:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445864.139703:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=302s v=(0 0) 00010000:00010000:2.0:1789445864.139707:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445864.139716:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b6e226e/0xc1b37c4d472563f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b61 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.139744:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b6e226e/0xc1b37c4d472563f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b61 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.139756:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57be400, rc 0) 00000100:00080000:1.0:1789445864.139951:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789445864.140024:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:0:x1876369722075520:12345-192.168.206.59@tcp:101:bash.0 Request processed in 424us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445864.140039:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 21 00000100:00100000:0.0:1789445864.150904:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445864.152619:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722075648 00000100:00100000:2.0:1789445864.152634:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722075648 00000100:00100000:2.0:1789445864.152701:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 22 00000100:00100000:2.0:1789445864.152711:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:10328:x1876369722075648:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:2.0:1789445864.152741:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445864.152760:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d472563fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b68 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.152792:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b6e226e/0xc1b37c4d472563f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b61 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.152802:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445864.152806:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445864.152811:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d472563fc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b68 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.152843:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b6e226e/0xc1b37c4d472563f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b61 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.152856:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b6e226e/0xc1b37c4d472563f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b61 expref: 8 pid: 6682 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445864.152870:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876369742033920:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445864.154150:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afead97e3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789445864.154603:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445864.160750:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445864.160876:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722075776 00000100:00100000:1.0:1789445864.160898:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722075776 00010000:00010000:1.0:1789445864.160946:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b6e226e/0xc1b37c4d472563f5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b61 expref: 9 pid: 6682 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445864.161000:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 35 00000100:00100000:1.0:1789445864.161013:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:2375:x1876369722075776:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789445864.161030:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445864.161089:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b6e226e/0xc1b37c4d472563f5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b61 expref: 9 pid: 6682 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.161105:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b6e226e/0xc1b37c4d472563f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b61 expref: 9 pid: 6682 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.161140:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445864.161147:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445864.161163:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b6e226e/0xc1b37c4d472563f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b61 expref: 9 pid: 6682 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.161163:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d472563fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b68 expref: 9 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.161193:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d472563fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b68 expref: 9 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445864.161206:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876369742033920:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789445864.161243:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d472563fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b68 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.161256:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d472563fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b68 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.161267:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf000, rc 0) 00000100:00100000:1.0:1789445864.161297:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1876369742034048:192.168.206.59@tcp:105: 00000100:00100000:3.0:1789445864.161336:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:10328:x1876369722075648:12345-192.168.206.59@tcp:101:bash.0 Request processed in 8625us (10438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445864.161351:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 22 00000100:00100000:1.0:1789445864.161367:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afd82cb4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789445864.166261:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1876369742034048:192.168.206.59@tcp:105: 00010000:00010000:2.0:1789445864.166296:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445864.166378:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2375:x1876369722075776:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 5365us (5633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445864.166411:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 35 00000100:00100000:1.0:1789445864.170458:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445864.170608:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722076032 00000100:00100000:0.0:1789445864.170617:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722076032 00000100:00100000:0.0:1789445864.170681:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00100000:0.0:1789445864.170693:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:10328:x1876369722076032:12345-192.168.206.59@tcp:35:bash.0 00000100:00100000:0.0:1789445864.171180:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:10328:x1876369722076032:12345-192.168.206.59@tcp:35:bash.0 Request processed in 486us (728us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789445864.171188:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00100000:3.0:1789445864.328646:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445864.328754:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722076288 00000100:00100000:1.0:1789445864.328764:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722076288 00000100:00100000:1.0:1789445864.328823:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 41 00000100:00100000:1.0:1789445864.328834:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:10338:x1876369722076288:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:1.0:1789445864.328859:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445864.328879:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256403 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b6f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445864.328973:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789445864.329137:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256403 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b6f expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.329151:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe8e97a500) 00010000:00010000:1.0:1789445864.329154:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789445864.329159:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256403 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b6f expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.329173:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6f800, rc 0) 00000100:00100000:1.0:1789445864.329229:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:10338:x1876369722076288:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 396us (591us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1789445864.329235:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 41 00000100:00100000:3.0:1789445864.343137:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445864.343296:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722076544 00000100:00100000:0.0:1789445864.343305:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722076544 00000100:00100000:0.0:1789445864.343361:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:0.0:1789445864.343373:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:10338:x1876369722076544:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:0.0:1789445864.343631:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+16:10338:x1876369722076544:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 260us (504us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789445864.343639:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:2.0:1789445864.473546:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445864.473973:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722076672 00000100:00100000:0.0:1789445864.473984:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722076672 00000100:00100000:0.0:1789445864.474083:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 42 00000100:00100000:0.0:1789445864.474094:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+16:10344:x1876369722076672:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:0.0:1789445864.474120:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445864.474140:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256411 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b76 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.474207:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256418 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.474221:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.474233:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445864.474290:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789445864.474301:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789445864.474326:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.474353:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256411 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b76 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.474370:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256418 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b76 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.474378:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:0.0:1789445864.474381:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789445864.474399:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907a00, rc 0) 00000100:00100000:0.0:1789445864.474932:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+17:10344:x1876369722076672:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 838us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445864.474940:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 42 00000100:00100000:3.0:1789445864.479617:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445864.479908:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722076928 00000100:00100000:1.0:1789445864.479917:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722076928 00000100:00100000:1.0:1789445864.479973:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 43 00000100:00100000:1.0:1789445864.479983:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+17:10344:x1876369722076928:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:1.0:1789445864.480002:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445864.480038:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d4725641f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.480167:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256426 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.480181:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.480192:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445864.480204:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789445864.480680:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d4725641f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b7d expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.480698:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256426 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b7d expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.480706:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe90eac500) 00010000:00010000:1.0:1789445864.480709:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789445864.480712:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6e200, rc 0) 00000100:00100000:1.0:1789445864.480777:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:10344:x1876369722076928:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 794us (1169us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789445864.480784:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 43 00000100:00100000:1.0:1789445864.484890:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445864.484930:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445864.485140:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722077312 00000100:00100000:0.0:1789445864.485149:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722077312 00000100:00100000:0.0:1789445864.485211:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 2 00000100:00100000:3.0:1789445864.485213:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722077184 00000100:00100000:3.0:1789445864.485217:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722077184 00000100:00100000:0.0:1789445864.485220:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:2374:x1876369722077312:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789445864.485234:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789445864.485255:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 44 00010000:00010000:0.0:1789445864.485257:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256426 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b7d expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445864.485262:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:10344:x1876369722077184:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:0.0:1789445864.485274:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe90eac500) 00010000:00010000:0.0:1789445864.485279:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789445864.485290:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445864.485311:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256434 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b84 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.485396:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725643b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445864.485405:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:2374:x1876369722077312:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 187us (474us total) trans 0 rc 0/0 00010000:00010000:3.0:1789445864.485409:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725643b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445864.485411:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 2 00010000:00010000:3.0:1789445864.485577:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725643b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445864.485590:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789445864.485702:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256434 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b84 expref: 21 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.485716:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725643b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b84 expref: 20 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.485740:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe90eac500) 00010000:00010000:3.0:1789445864.485743:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789445864.485745:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fd200, rc 0) 00000100:00100000:3.0:1789445864.485784:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:10344:x1876369722077184:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 522us (902us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789445864.485790:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 44 00000100:00100000:1.0:1789445864.496986:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445864.497363:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722077440 00000100:00100000:0.0:1789445864.497373:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722077440 00000100:00100000:0.0:1789445864.497436:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 23 00000100:00100000:0.0:1789445864.497446:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2375:x1876369722077440:12345-192.168.206.59@tcp:1:lfs.0 00010000:00010000:0.0:1789445864.497501:0:11692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053e48d19/0xc1b37c4d47256449 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.497522:0:11692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d472563fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b68 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.497547:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445864.497551:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789445864.497555:0:11692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053e48d19/0xc1b37c4d47256449 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.497586:0:11692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d472563fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b68 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.497599:0:11692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d472563fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b68 expref: 7 pid: 6684 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445864.497626:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11692:1876369742034176:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445864.497720:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe85da7480 going to sleep for 11 seconds 00000100:00100000:0.0:1789445864.501260:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11692:1876369742034176:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789445864.501295:0:11692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000053e48d19/0xc1b37c4d47256449 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445864.502319:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445864.502430:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722077568 00000100:00100000:0.0:1789445864.502438:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722077568 00002000:00100000:0.0:1789445864.502494:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9afeba5cc700 x1876369722077568/t0(0) o4->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:745/0 lens 504/0 e 0 to 0 dl 1789445875 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789445864.502504:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afeba5cc700 with x1876369722077568 ext(0->12) 00010000:00010000:0.0:1789445864.502512:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d472563fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b68 expref: 8 pid: 6684 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.502544:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d472563fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b68 expref: 8 pid: 6684 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789445864.502552:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9afeba5cc700 00000100:00100000:0.0:1789445864.502585:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 0 00000100:00100000:0.0:1789445864.502595:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2375:x1876369722077568:12345-192.168.206.59@tcp:4:lfs.0 00000001:00100000:2.0:1789445864.563518:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4a94602d-5f10-4cb2-abf8-c0de02603d85 00000100:00100000:1.0:1789445864.564819:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:2375:x1876369722077568:12345-192.168.206.59@tcp:4:lfs.0 Request processed in 62219us (62498us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789445864.564905:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 0 00002000:00100000:1.0:1789445864.564920:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9afeba5cc700 x1876369722077568/t4294967299(0) o4->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:745/0 lens 504/448 e 0 to 0 dl 1789445875 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789445864.564930:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afeba5cc700 with x1876369722077568 ext(0->12) 00010000:00010000:1.0:1789445864.564941:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d472563fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b68 expref: 9 pid: 6684 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.564962:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d472563fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b68 expref: 9 pid: 6684 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789445864.564970:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9afeba5cc700 00000100:00100000:3.0:1789445864.571871:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445864.572247:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722077696 00000100:00100000:2.0:1789445864.572257:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722077696 00010000:00010000:2.0:1789445864.572316:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d472563fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b68 expref: 9 pid: 6684 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445864.572360:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 36 00000100:00100000:2.0:1789445864.572370:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a305880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:2374:x1876369722077696:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445864.572387:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789445864.572408:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789445864.572412:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789445864 00002000:00010000:2.0:1789445864.572414:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789445864 00002000:00010000:2.0:1789445864.572417:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789445864 00010000:00010000:2.0:1789445864.572424:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d472563fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b68 expref: 9 pid: 6684 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.572439:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d472563fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b68 expref: 9 pid: 6684 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.572478:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d472563fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b68 expref: 9 pid: 6684 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.572496:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789445864.572517:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789445864.572523:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053e48d19/0xc1b37c4d47256449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.572533:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053e48d19/0xc1b37c4d47256449 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.572571:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789445864.572751:0:11692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000053e48d19/0xc1b37c4d47256449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.572762:0:11692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053e48d19/0xc1b37c4d47256449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.572797:0:11692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053e48d19/0xc1b37c4d47256449 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.572806:0:11692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053e48d19/0xc1b37c4d47256449 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.572815:0:11692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053e48d19/0xc1b37c4d47256449 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.572822:0:11692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907e00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445864.572826:0:11692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053e48d19/0xc1b37c4d47256449 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.572860:0:11692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053e48d19/0xc1b37c4d47256449 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.572875:0:11692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053e48d19/0xc1b37c4d47256449 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.572883:0:11692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053e48d19/0xc1b37c4d47256449 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445864.574071:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a305880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2374:x1876369722077696:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 1674us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445864.574084:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 36 00000100:00100000:0.0:1789445864.575093:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2375:x1876369722077440:12345-192.168.206.59@tcp:1:lfs.0 Request processed in 77643us (78109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445864.575105:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 23 00000100:00100000:2.0:1789445864.587177:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445864.587566:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722077952 00000100:00100000:0.0:1789445864.587765:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722077952 00000100:00100000:0.0:1789445864.588097:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 8 00000100:00100000:0.0:1789445864.588109:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:10344:x1876369722077952:12345-192.168.206.59@tcp:35:lfs.0 00000004:00010000:0.0:1789445864.588172:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725643b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b84 expref: 20 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789445864.588749:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1789445864.588852:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1789445864.590185:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1789445864.590263:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256450 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.590986:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d472563e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b5a expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.591010:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256450 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.591149:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d472563e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b5a expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.591166:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d472563e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b5a expref: 24 pid: 5840 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445864.591181:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1876369742034304:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445864.591354:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe85da7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789445864.598713:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445864.598842:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1876369742034304:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789445864.598869:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256450 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445864.599142:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722078080 00000100:00100000:3.0:1789445864.599149:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722078080 00010000:00010000:3.0:1789445864.599184:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d472563e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b5a expref: 25 pid: 5840 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445864.599230:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 37 00000100:00100000:3.0:1789445864.599239:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+25:2374:x1876369722078080:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445864.599253:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445864.599259:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d472563e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b5a expref: 25 pid: 5840 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.599279:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d472563e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b5a expref: 25 pid: 5840 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.599307:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d472563e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b5a expref: 25 pid: 5840 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.599336:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe90eac500) 00010000:00010000:3.0:1789445864.599341:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256450 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.599350:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256450 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.599357:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256450 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.599388:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445864.599816:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:2374:x1876369722078080:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 575us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445864.599825:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 37 00010000:00010000:0.0:1789445864.599955:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256450 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.599962:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256450 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789445864.600133:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789445864.600371:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1789445864.600766:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876369742034432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789445864.601394:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445864.601637:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe85da7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789445864.601794:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742034432 00000100:00100000:3.0:1789445864.601815:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742034432 00000100:00100000:3.0:1789445864.601880:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789445864.601889:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1876369742034432:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789445864.601980:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1876369742034432:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 91us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445864.601987:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789445864.602139:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876369742034432:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789445864.603148:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1789445864.603238:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876369742034560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789445864.605674:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445864.605729:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe82e93840 going to sleep for 11 seconds 00000100:00100000:0.0:1789445864.606504:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742034560 00000100:00100000:0.0:1789445864.606526:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742034560 00000100:00100000:0.0:1789445864.606573:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789445864.606582:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1876369742034560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789445864.606853:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1876369742034560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 272us (1184us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789445864.606860:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789445864.607237:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876369742034560:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789445864.607334:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1789445864.607388:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256450 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.607399:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256450 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.607414:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256450 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.607420:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445864.607424:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256450 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.607432:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256450 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.607446:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe90eac500) 00010000:00010000:3.0:1789445864.607448:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789445864.607453:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256450 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445864.607459:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256450 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789445864.607776:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789445864.609767:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789445864.609786:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 302631740130ns, next at 303631737170ns, rc = 0 00000001:00080000:3.0:1789445864.609810:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1789445864.609881:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe90eac500) 00010000:00010000:3.0:1789445864.609887:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789445864.609897:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725643b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b84 expref: 28 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445864.610023:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+27:10344:x1876369722077952:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 21916us (22853us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1789445864.610070:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 8 00000020:00080000:3.0:1789445864.610076:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789445864.614200:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445864.614339:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722078208 00000100:00100000:1.0:1789445864.614350:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722078208 00000100:00100000:1.0:1789445864.614410:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 45 00000100:00100000:1.0:1789445864.614421:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+27:10344:x1876369722078208:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:1.0:1789445864.614442:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445864.614478:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256457 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b8b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.614555:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256457 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b8b expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.614569:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256457 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b8b expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.614585:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:1.0:1789445864.614588:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789445864.614591:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6ec00, rc 0) 00000100:00100000:1.0:1789445864.614651:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+28:10344:x1876369722078208:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 232us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445864.614658:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 45 00000100:00100000:2.0:1789445864.621097:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445864.621452:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722078464 00000100:00100000:1.0:1789445864.621475:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722078464 00000100:00100000:1.0:1789445864.621521:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00100000:1.0:1789445864.621530:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fcc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+28:10344:x1876369722078464:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:1.0:1789445864.621737:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fcc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+29:10344:x1876369722078464:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 206us (691us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789445864.621744:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00100000:3.0:1789445864.754562:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445864.754666:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722078720 00000100:00100000:0.0:1789445864.754675:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722078720 00000100:00100000:0.0:1789445864.754760:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 46 00000100:00100000:0.0:1789445864.754771:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+29:10354:x1876369722078720:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:0.0:1789445864.754795:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445864.754823:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d4725645e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b92 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445864.754910:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789445864.755015:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d4725645e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b92 expref: 31 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.755029:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe8e97a500) 00010000:00010000:0.0:1789445864.755032:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789445864.755036:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d4725645e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b92 expref: 31 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445864.755080:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906a00, rc 0) 00000100:00100000:0.0:1789445864.755183:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+30:10354:x1876369722078720:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 413us (629us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1789445864.755190:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 46 00000100:00100000:0.0:1789445864.759885:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445864.760000:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722078848 00000100:00100000:1.0:1789445864.760010:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722078848 00000100:00100000:1.0:1789445864.760085:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 47 00000100:00100000:1.0:1789445864.760095:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+30:10354:x1876369722078848:12345-192.168.206.59@tcp:34:lfs.0 00010000:00010000:1.0:1789445864.760165:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d4725646c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760199:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d4725646c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760210:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d4725646c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760227:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256473 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760233:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256473 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760239:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256473 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760593:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725647a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760602:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725647a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760610:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725647a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789445864.760654:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725647a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760668:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d4725646c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760675:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d4725646c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760692:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d4725646c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760698:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445864.760702:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d4725646c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760709:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d4725646c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760721:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:1.0:1789445864.760723:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445864.760728:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d4725646c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760734:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d4725646c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760748:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256473 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760753:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256473 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760759:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256473 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760763:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6ee00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445864.760766:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256473 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760780:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256473 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760788:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe858f5a00) 00010000:00010000:1.0:1789445864.760790:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445864.760792:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256473 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760797:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256473 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760888:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725647a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760893:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725647a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760898:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725647a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760903:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445864.760906:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725647a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760912:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725647a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760919:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:1.0:1789445864.760922:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445864.760925:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725647a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.760940:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725647a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445864.761195:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+30:10354:x1876369722078848:12345-192.168.206.59@tcp:34:lfs.0 Request processed in 1098us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445864.761204:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 47 00000100:00100000:3.0:1789445864.770821:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445864.770925:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722079104 00000100:00100000:0.0:1789445864.770934:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722079104 00000100:00100000:0.0:1789445864.770983:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:0.0:1789445864.770992:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+30:10354:x1876369722079104:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:0.0:1789445864.771227:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+31:10354:x1876369722079104:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 236us (413us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789445864.771234:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:3.0:1789445864.830116:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445864.830223:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722079360 00000100:00100000:2.0:1789445864.830232:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722079360 00000100:00100000:2.0:1789445864.830301:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 48 00000100:00100000:2.0:1789445864.830311:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+31:10357:x1876369722079360:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:2.0:1789445864.830338:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445864.830361:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256481 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4b99 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830459:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256488 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830487:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256488 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830499:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256488 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830515:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725648f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830539:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725648f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830547:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725648f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830661:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256496 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830670:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830678:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445864.830689:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789445864.830787:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256488 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830795:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256488 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830802:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256488 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830809:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445864.830813:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256488 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830820:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256488 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830843:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:2.0:1789445864.830846:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445864.830851:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256488 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830858:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256488 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830871:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725648f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830878:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725648f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830884:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725648f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830890:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445864.830893:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725648f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830900:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725648f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830908:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe90eac000) 00010000:00010000:2.0:1789445864.830910:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445864.830913:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725648f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830920:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725648f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830977:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256481 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b99 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.830992:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256496 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b99 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445864.831000:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:2.0:1789445864.831001:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789445864.831004:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf600, rc 0) 00000100:00100000:2.0:1789445864.831124:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+33:10357:x1876369722079360:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 815us (1017us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789445864.831132:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 48 00000100:00100000:2.0:1789445864.836458:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445864.836598:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722079488 00000100:00100000:1.0:1789445864.836607:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722079488 00000100:00100000:1.0:1789445864.836670:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 49 00000100:00100000:1.0:1789445864.836681:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+33:10357:x1876369722079488:12345-192.168.206.59@tcp:54:lfs.0 00010000:00010000:1.0:1789445864.836751:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d472564a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.836767:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d472564a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.836778:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d472564a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.836815:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d472564a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.836823:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d472564a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.836830:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d472564a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.836835:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445864.836840:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d472564a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.836862:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d472564a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.836875:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:1.0:1789445864.836878:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789445864.836882:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d472564a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445864.836887:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d472564a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445864.836963:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+33:10357:x1876369722079488:12345-192.168.206.59@tcp:54:lfs.0 Request processed in 284us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445864.836970:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 49 00000100:00100000:3.0:1789445864.840656:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445864.840756:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722079744 00000100:00100000:0.0:1789445864.840767:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722079744 00000100:00100000:0.0:1789445864.840827:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00100000:0.0:1789445864.840837:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+33:10357:x1876369722079744:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:0.0:1789445864.841553:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+34:10357:x1876369722079744:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 713us (905us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789445864.841563:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 11 00010000:00010000:2.0:1789445865.178223:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445865.253809:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445865.255679:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722080000 00000100:00100000:2.0:1789445865.255694:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722080000 00000100:00100000:2.0:1789445865.255785:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 50 00000100:00100000:2.0:1789445865.255797:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+34:10388:x1876369722080000:12345-192.168.206.59@tcp:101:cat.0 00010000:00010000:2.0:1789445865.255822:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445865.255854:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472564ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ba0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445865.255967:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d472564b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445865.255984:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d472564b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445865.256016:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d472564b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445865.256028:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789445865.256782:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472564ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ba0 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445865.256804:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d472564b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ba0 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445865.256812:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:2.0:1789445865.256815:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789445865.256818:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf000, rc 0) 00000100:00080000:1.0:1789445865.256988:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445865.257029:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+36:10388:x1876369722080000:12345-192.168.206.59@tcp:101:cat.0 Request processed in 1234us (3229us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789445865.257038:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 50 00000100:00100000:2.0:1789445865.267739:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445865.267790:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445865.267942:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722080256 00000100:00100000:0.0:1789445865.267952:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722080256 00000100:00100000:0.0:1789445865.268008:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 12 00000100:00100000:0.0:1789445865.268020:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+36:10388:x1876369722080256:12345-192.168.206.59@tcp:35:cat.0 00000100:00100000:0.0:1789445865.268359:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+37:10388:x1876369722080256:12345-192.168.206.59@tcp:35:cat.0 Request processed in 340us (627us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789445865.268367:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 12 00000100:00100000:1.0:1789445865.272974:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722080384 00000100:00100000:1.0:1789445865.272991:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722080384 00000100:00100000:1.0:1789445865.273165:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 3 00000100:00100000:1.0:1789445865.273176:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe919b1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+37:2376:x1876369722080384:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789445865.273191:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445865.273214:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d472564b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ba0 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.273233:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:1.0:1789445865.273238:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445865.273502:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe919b1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+36:2376:x1876369722080384:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 327us (5709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445865.273511:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 3 00000100:00100000:2.0:1789445865.357760:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445865.357932:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722080640 00000100:00100000:0.0:1789445865.357942:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722080640 00000100:00100000:0.0:1789445865.358033:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 51 00000100:00100000:0.0:1789445865.358060:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+36:10394:x1876369722080640:12345-192.168.206.59@tcp:101:dd.0 00010000:00010000:0.0:1789445865.358104:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445865.358107:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789445865.358132:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256418 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b76 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.358150:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:0.0:1789445865.358155:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789445865.358166:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472564c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ba7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.358262:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472564c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.358509:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256496 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b99 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.358518:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472564c7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.358550:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256496 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b99 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.358563:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256496 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b99 expref: 36 pid: 5840 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445865.358577:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742034688:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445865.358729:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afead97e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789445865.363201:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445865.364212:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722080768 00000100:00100000:1.0:1789445865.364226:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722080768 00010000:00010000:1.0:1789445865.364283:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256496 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b99 expref: 37 pid: 5840 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445865.364504:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 38 00000100:00100000:1.0:1789445865.364514:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+37:2375:x1876369722080768:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789445865.364528:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445865.364536:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256496 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b99 expref: 37 pid: 5840 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.364549:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256496 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b99 expref: 37 pid: 5840 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.364570:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:1.0:1789445865.364576:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472564c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.364585:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472564c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.364593:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472564c7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.364612:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445865.364671:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+37:2375:x1876369722080768:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 158us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445865.364678:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 38 00010000:00010000:0.0:1789445865.364775:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256496 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b99 expref: 36 pid: 5840 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445865.364816:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742034688:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789445865.364839:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472564c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.364848:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472564c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.364853:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472564c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445865.364873:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789445865.365035:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472564c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ba7 expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.365075:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472564c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ba7 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.365082:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:0.0:1789445865.365085:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789445865.365087:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907200, rc 0) 00000100:00100000:0.0:1789445865.365113:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+36:10394:x1876369722080640:12345-192.168.206.59@tcp:101:dd.0 Request processed in 7072us (7362us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789445865.365119:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 51 00000100:00100000:2.0:1789445865.369196:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445865.369540:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722081024 00000100:00100000:0.0:1789445865.369551:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722081024 00000100:00100000:0.0:1789445865.369648:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 52 00000100:00100000:0.0:1789445865.369658:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+36:10394:x1876369722081024:12345-192.168.206.59@tcp:36:dd.0 00010000:00010000:0.0:1789445865.370017:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472564d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.370033:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472564d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.370068:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472564d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789445865.370123:0:8204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1789445865.370149:0:8204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7bc2716 reply state 00000000f7a4b670 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472564d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445865.370157:0:8204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789445865.370369:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+39:10394:x1876369722081024:12345-192.168.206.59@tcp:36:dd.0 Request processed in 711us (1180us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789445865.370377:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 52 00000020:00080000:0.0:1789445865.370382:0:8204:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789445865.373252:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472564d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445865.374926:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472564d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445865.374937:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472564d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445865.374943:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445865.374947:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472564d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445865.374956:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472564d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445865.374971:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:3.0:1789445865.374974:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445865.374979:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472564d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445865.374985:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472564d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445865.809155:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445865.810363:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722081152 00000100:00100000:0.0:1789445865.810376:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722081152 00000100:00100000:0.0:1789445865.811449:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 53 00000100:00100000:0.0:1789445865.811476:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+38:10408:x1876369722081152:12345-192.168.206.59@tcp:101:stat.0 00010000:00010000:0.0:1789445865.811505:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445865.811526:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472564dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4bae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.811594:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472564e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.811608:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472564e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.811634:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472564e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.811649:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472564ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.811656:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472564ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.811662:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472564ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.812220:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472564f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.812234:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472564c7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ba7 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.812242:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472564f1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.812476:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472564c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ba7 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.812492:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472564c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ba7 expref: 39 pid: 5841 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445865.812505:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742034816:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445865.812745:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8568e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789445865.816916:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742034816:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789445865.816948:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472564f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445865.820988:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445865.821331:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722081408 00000100:00100000:0.0:1789445865.821340:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722081408 00000100:00100000:0.0:1789445865.821449:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 13 00000100:00100000:0.0:1789445865.821469:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+40:5628:x1876369722081408:12345-192.168.206.59@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789445865.821995:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+41:5628:x1876369722081408:12345-192.168.206.59@tcp:35:ldlm_bl.0 Request processed in 536us (1016us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1789445865.822004:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 13 00000100:00100000:2.0:1789445865.825781:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445865.825891:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722081536 00000100:00100000:1.0:1789445865.825915:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722081536 00010000:00010000:1.0:1789445865.825955:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472564c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ba7 expref: 41 pid: 5841 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445865.825996:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 39 00000100:00100000:1.0:1789445865.826007:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+41:2375:x1876369722081536:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789445865.826022:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445865.826028:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472564c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ba7 expref: 41 pid: 5841 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.826042:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472564c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ba7 expref: 41 pid: 5841 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.826091:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472564c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ba7 expref: 41 pid: 5841 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.826124:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:1.0:1789445865.826129:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472564f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.826139:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472564f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.826146:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472564f1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.826178:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445865.826238:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+40:2375:x1876369722081536:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 232us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445865.826254:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 39 00010000:00010000:0.0:1789445865.827853:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472564f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.827867:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472564f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445865.827914:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789445865.827919:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789445865.827967:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472564f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.827982:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472564f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.827992:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472564e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.827998:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472564e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.828019:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472564e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.828025:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445865.828029:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472564e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.828038:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472564e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.828232:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:0.0:1789445865.828236:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445865.828241:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472564e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.828247:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472564e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.828260:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472564ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.828266:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472564ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.828273:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472564ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.828278:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445865.828281:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472564ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.828298:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472564ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.828306:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe98961100) 00010000:00010000:0.0:1789445865.828309:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445865.828311:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472564ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.828317:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472564ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.828357:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472564dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bae expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.828372:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472564f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bae expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.828377:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:0.0:1789445865.828379:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789445865.828381:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906800, rc 0) 00000100:00100000:0.0:1789445865.828440:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+39:10408:x1876369722081152:12345-192.168.206.59@tcp:101:stat.0 Request processed in 16980us (19292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445865.828449:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 53 00000100:00100000:2.0:1789445865.926893:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445865.927090:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722081792 00000100:00100000:0.0:1789445865.927108:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722081792 00000100:00100000:0.0:1789445865.927164:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 54 00000100:00100000:0.0:1789445865.927173:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+39:10414:x1876369722081792:12345-192.168.206.59@tcp:36:truncate.0 00010000:00010000:0.0:1789445865.927255:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445865.928027:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472564f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bae expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.928177:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:0.0:1789445865.928183:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789445865.928558:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472564f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.928572:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472564f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445865.928581:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472564f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789445865.928634:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1789445865.928661:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000920ca8ea reply state 000000008f5557d6 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472564f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445865.928670:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789445865.928950:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+41:10414:x1876369722081792:12345-192.168.206.59@tcp:36:truncate.0 Request processed in 1776us (2064us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789445865.928958:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 54 00000020:00080000:0.0:1789445865.928964:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789445865.934198:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472564f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.934218:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472564f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.934226:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472564f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.934231:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445865.934236:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472564f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.934243:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472564f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.934258:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:1.0:1789445865.934261:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445865.934629:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472564f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445865.934638:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472564f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789445866.205772:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00010000:00010000:2.0:1789445866.206079:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789445866.206726:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9afe82e93e40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789445866.206734:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afe9d5b5600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9afe82e93240 00000020:00080000:3.0:1789445866.206738:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afe9d5b5a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9afeba0cbc00 00000004:00080000:3.0:1789445866.206792:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1789445866.206895:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:0.0:1789445866.207078:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789445866.207104:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742034944:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1789445866.207120:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789445866.207182:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445866.207255:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742034944 00000100:00100000:1.0:1789445866.207273:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742034944 00000100:00080000:0.0:1789445866.207347:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789445866.207366:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789445866.207377:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1876369742034944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789445866.207437:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789445866.207494:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa8c6e8, atime: 0x6aa8c6e8, ctime: 0x6aa8c6e8, blocks: 0x1 00010000:00010000:1.0:1789445866.207503:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d472564ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.207522:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=304s v=(0 0) 00010000:00010000:1.0:1789445866.207527:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445866.207534:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d472564ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.207552:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d472564ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.207563:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d472564ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.207571:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d472564ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.207602:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789445866.208256:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445866.208266:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d472564ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.208296:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e800 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445866.208301:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d472564ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.208313:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d472564ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.208334:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d472564ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.208342:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d472564ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.208365:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445866.208366:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445866.208368:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445866.209837:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445866.210781:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1876369742034944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3400us (3593us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789445866.210793:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789445866.211465:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722081920 00000004:00080000:3.0:1789445866.211476:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afead8fdc00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789445866.211476:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722081920 00000100:00100000:3.0:1789445866.211486:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742034944:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789445866.217749:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 55 00000100:00100000:2.0:1789445866.217768:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+10:10428:x1876369722081920:12345-192.168.206.59@tcp:101:stat.0 00010000:00010000:2.0:1789445866.217824:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445866.217854:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256506 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4bb5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.217939:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d4725650d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.217958:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d4725650d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.217973:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d4725650d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.217990:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256514 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.217998:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218005:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218386:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725651b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218397:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725651b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218405:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725651b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445866.218469:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789445866.218480:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789445866.218515:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725651b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218529:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725651b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218538:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d4725650d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218545:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d4725650d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218553:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d4725650d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218560:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bee00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445866.218564:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d4725650d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218573:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d4725650d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218587:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:2.0:1789445866.218590:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445866.218596:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d4725650d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218603:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d4725650d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218616:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218633:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256514 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218639:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218644:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445866.218647:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218654:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256514 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218662:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe90eac500) 00010000:00010000:2.0:1789445866.218665:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445866.218668:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256514 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218674:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256514 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218713:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256506 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bb5 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218730:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725651b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bb5 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.218738:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:2.0:1789445866.218741:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789445866.218750:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57be400, rc 0) 00000100:00100000:2.0:1789445866.218840:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+11:10428:x1876369722081920:12345-192.168.206.59@tcp:101:stat.0 Request processed in 1076us (9015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445866.218848:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 55 00000100:00100000:2.0:1789445866.319829:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445866.319890:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722082176 00000100:00100000:3.0:1789445866.319905:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722082176 00000100:00100000:3.0:1789445866.319970:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 56 00000100:00100000:3.0:1789445866.319979:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+11:10438:x1876369722082176:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445866.319999:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445866.320018:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256522 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4bbc expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445866.320149:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789445866.320719:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256522 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bbc expref: 13 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445866.320734:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe8e97a500) 00010000:00010000:3.0:1789445866.320737:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789445866.320742:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256522 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bbc expref: 13 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445866.320776:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fd200, rc 0) 00000100:00100000:3.0:1789445866.320851:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+12:10438:x1876369722082176:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 873us (1031us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1789445866.320859:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 56 00000100:00100000:2.0:1789445866.327239:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445866.327350:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722082432 00000100:00100000:3.0:1789445866.327361:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722082432 00000100:00100000:0.0:1789445866.327441:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 14 00000100:00100000:0.0:1789445866.327466:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+12:10438:x1876369722082432:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:3.0:1789445866.327521:0:5843:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1789445866.327530:0:5843:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1789445866.327916:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:10438:x1876369722082432:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 464us (683us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789445866.327924:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 14 00000100:00100000:2.0:1789445866.419857:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445866.421015:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722082688 00000100:00100000:1.0:1789445866.421028:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722082688 00000100:00100000:1.0:1789445866.421148:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 57 00000100:00100000:1.0:1789445866.421159:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:10444:x1876369722082688:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:1.0:1789445866.421195:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445866.421214:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256530 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4bc3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.421402:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256537 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.421416:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725651b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bb5 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.421426:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256537 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.421470:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725651b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bb5 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.421483:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725651b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bb5 expref: 14 pid: 5841 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445866.421504:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb2ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742035072:192.168.206.59@tcp:104: 00000100:00100000:1.0:1789445866.421588:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe85da73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445866.426695:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb2ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742035072:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789445866.426723:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256537 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445866.429374:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445866.429474:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722082816 00000100:00100000:3.0:1789445866.429482:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722082816 00010000:00010000:3.0:1789445866.429522:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725651b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bb5 expref: 15 pid: 5841 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445866.429564:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 40 00000100:00100000:3.0:1789445866.429574:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:2375:x1876369722082816:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445866.429589:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445866.429596:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725651b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bb5 expref: 15 pid: 5841 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445866.429609:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725651b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bb5 expref: 15 pid: 5841 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445866.429628:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725651b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bb5 expref: 15 pid: 5841 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445866.429643:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:3.0:1789445866.429659:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256537 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445866.429668:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256537 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445866.429675:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256537 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445866.429708:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445866.429766:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:2375:x1876369722082816:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 194us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445866.429774:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 40 00010000:00010000:2.0:1789445866.430353:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256537 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.430363:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256537 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445866.430382:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789445866.430531:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256530 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bc3 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.430547:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256537 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bc3 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445866.430554:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:2.0:1789445866.430557:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789445866.430560:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6e000, rc 0) 00000100:00100000:2.0:1789445866.430600:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:10444:x1876369722082688:12345-192.168.206.59@tcp:101:bash.0 Request processed in 9443us (10751us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789445866.430607:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 57 00000100:00100000:2.0:1789445866.440006:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445866.440179:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722083072 00000100:00100000:0.0:1789445866.440188:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722083072 00000100:00100000:0.0:1789445866.440371:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 58 00000100:00100000:0.0:1789445866.440382:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:10444:x1876369722083072:12345-192.168.206.59@tcp:36:bash.0 00010000:00010000:0.0:1789445866.440648:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256545 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.440665:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256545 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.440676:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256545 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789445866.440720:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1789445866.440740:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e5d8e9b reply state 0000000059bd8d1e transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256545 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445866.440748:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789445866.440855:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+17:10444:x1876369722083072:12345-192.168.206.59@tcp:36:bash.0 Request processed in 474us (855us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789445866.440863:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 58 00000020:00080000:0.0:1789445866.440868:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789445866.444404:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256545 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.444420:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256545 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.444427:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256545 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.444434:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445866.444439:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256545 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.444474:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256545 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.444490:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:0.0:1789445866.444493:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445866.444497:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256545 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.444503:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256545 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445866.454578:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445866.454696:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722083200 00000100:00100000:0.0:1789445866.454705:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722083200 00000100:00100000:0.0:1789445866.454763:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 59 00000100:00100000:0.0:1789445866.454774:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+16:10444:x1876369722083200:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:0.0:1789445866.454796:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445866.454817:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d4725654c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4bca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.454926:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256553 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.454941:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256537 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bc3 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.454949:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256553 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.454980:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256537 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bc3 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.455006:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256537 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bc3 expref: 17 pid: 5841 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445866.455019:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742035200:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445866.455140:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea485b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445866.458924:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742035200:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789445866.458952:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256553 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445866.460660:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445866.461692:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722083328 00000100:00100000:1.0:1789445866.461705:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722083328 00010000:00010000:1.0:1789445866.461748:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256537 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bc3 expref: 18 pid: 5841 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445866.461810:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 41 00000100:00100000:1.0:1789445866.461831:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba628e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:2375:x1876369722083328:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789445866.461848:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445866.461855:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256537 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bc3 expref: 18 pid: 5841 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.461868:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256537 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bc3 expref: 18 pid: 5841 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.461901:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256537 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bc3 expref: 18 pid: 5841 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.461918:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:1.0:1789445866.461923:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256553 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.461933:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.461941:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256553 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.461976:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445866.462037:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba628e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+17:2375:x1876369722083328:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 218us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445866.462086:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 41 00010000:00010000:0.0:1789445866.462396:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.462406:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445866.462478:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789445866.462482:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789445866.462503:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.462534:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d4725654c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bca expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.462549:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bca expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.462557:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:0.0:1789445866.462569:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789445866.462573:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907a00, rc 0) 00000100:00100000:0.0:1789445866.462616:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+16:10444:x1876369722083200:12345-192.168.206.59@tcp:101:bash.0 Request processed in 7844us (8048us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445866.462624:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 59 00000100:00100000:2.0:1789445866.469570:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445866.470661:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722083584 00000100:00100000:0.0:1789445866.470674:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722083584 00000100:00100000:0.0:1789445866.470727:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 15 00000100:00100000:0.0:1789445866.470737:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c00850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+16:10444:x1876369722083584:12345-192.168.206.59@tcp:35:bash.0 00000100:00100000:0.0:1789445866.470983:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c00850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+17:10444:x1876369722083584:12345-192.168.206.59@tcp:35:bash.0 Request processed in 246us (1421us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789445866.470991:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 15 00000100:00100000:3.0:1789445866.587130:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742035328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789445866.587193:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445866.587481:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742035328 00000100:00100000:1.0:1789445866.587500:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742035328 00000100:00100000:1.0:1789445866.587545:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789445866.587553:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1876369742035328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789445866.587584:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445866.588419:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1876369742035328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 863us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445866.588428:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789445866.592067:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742035328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789445866.609474:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445866.609963:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722083840 00000100:00100000:3.0:1789445866.609973:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722083840 00000100:00100000:3.0:1789445866.610031:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 60 00000100:00100000:3.0:1789445866.610041:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+17:10454:x1876369722083840:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445866.610086:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445866.610104:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725655a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4bd1 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445866.610183:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789445866.610400:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725655a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bd1 expref: 19 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445866.610415:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe8e97a500) 00010000:00010000:3.0:1789445866.610418:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789445866.610434:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725655a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bd1 expref: 19 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445866.610449:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fd200, rc 0) 00000100:00100000:3.0:1789445866.610514:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:10454:x1876369722083840:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 475us (1060us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1789445866.610521:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 60 00000100:00100000:2.0:1789445866.622600:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445866.622748:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722083968 00000100:00100000:1.0:1789445866.622762:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722083968 00000100:00100000:1.0:1789445866.622846:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 61 00000100:00100000:1.0:1789445866.622864:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:10454:x1876369722083968:12345-192.168.206.59@tcp:34:lfs.0 00010000:00010000:1.0:1789445866.622997:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256568 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.623017:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256568 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.623033:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256568 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.623084:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725656f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.623093:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725656f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.623100:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725656f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.623954:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256576 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.623998:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.624006:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789445866.624095:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.624107:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256568 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.624114:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256568 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.624121:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256568 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.624126:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445866.624131:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256568 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.624612:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256568 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.624634:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:1.0:1789445866.624641:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445866.624649:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256568 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.624662:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256568 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.624704:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725656f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.624714:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725656f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.624723:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725656f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.624734:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445866.624737:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725656f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.624750:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725656f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.624764:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe858f5400) 00010000:00010000:1.0:1789445866.624769:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445866.624773:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725656f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.624800:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d4725656f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.626624:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.626638:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256576 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.626645:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256576 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.626662:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6f200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445866.626666:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256576 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.626673:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256576 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.626686:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:1.0:1789445866.626689:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445866.626693:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256576 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.626699:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256576 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445866.626797:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:10454:x1876369722083968:12345-192.168.206.59@tcp:34:lfs.0 Request processed in 3936us (4202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445866.626807:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 61 00000100:00100000:2.0:1789445866.633752:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445866.633848:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722084224 00000100:00100000:1.0:1789445866.633858:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722084224 00000100:00100000:1.0:1789445866.633926:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 16 00000100:00100000:1.0:1789445866.633936:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:10454:x1876369722084224:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:1.0:1789445866.634199:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:10454:x1876369722084224:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 264us (456us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789445866.634208:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 16 00000100:00100000:2.0:1789445866.700614:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445866.700714:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722084480 00000100:00100000:0.0:1789445866.700724:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722084480 00000100:00100000:0.0:1789445866.700782:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 62 00000100:00100000:0.0:1789445866.700805:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:10457:x1876369722084480:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:0.0:1789445866.701094:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445866.701117:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d4725657d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4bd8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701192:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256584 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701207:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256584 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701219:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256584 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701249:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d4725658b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701257:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d4725658b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701277:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d4725658b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701591:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256592 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701600:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701608:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445866.701617:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789445866.701702:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256584 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701711:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256584 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701718:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256584 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701724:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445866.701728:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256584 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701743:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256584 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701755:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:0.0:1789445866.701757:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445866.701762:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256584 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701768:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256584 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701781:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d4725658b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701788:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d4725658b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701808:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d4725658b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701813:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445866.701816:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d4725658b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.701822:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d4725658b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.702246:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe98961100) 00010000:00010000:0.0:1789445866.702250:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445866.702253:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d4725658b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.702973:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d4725658b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.703030:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d4725657d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bd8 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.703177:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bd8 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.703187:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:0.0:1789445866.703190:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789445866.703193:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907200, rc 0) 00000100:00100000:0.0:1789445866.703307:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:10457:x1876369722084480:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 2516us (2700us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789445866.703315:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 62 00000100:00100000:2.0:1789445866.716770:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445866.717572:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445866.717654:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722084736 00000100:00100000:0.0:1789445866.717662:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722084736 00000100:00100000:0.0:1789445866.717718:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 63 00000100:00100000:0.0:1789445866.717729:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:10457:x1876369722084736:12345-192.168.206.59@tcp:54:lfs.0 00010000:00010000:0.0:1789445866.717790:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472565a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.717819:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472565a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.717831:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472565a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.717882:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472565a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.717891:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472565a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.717898:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472565a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.717904:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445866.717909:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472565a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.717917:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472565a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.717929:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:0.0:1789445866.717932:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789445866.717937:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472565a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.717944:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472565a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445866.718015:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:10457:x1876369722084736:12345-192.168.206.59@tcp:54:lfs.0 Request processed in 288us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445866.718023:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 63 00000100:00100000:3.0:1789445866.720543:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722084608 00000100:00100000:3.0:1789445866.720556:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722084608 00000100:00100000:3.0:1789445866.720681:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 4 00000100:00100000:3.0:1789445866.720692:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:2377:x1876369722084608:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445866.720706:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445866.720730:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256592 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bd8 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445866.720747:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:3.0:1789445866.720752:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445866.720822:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:2377:x1876369722084608:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 132us (4059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445866.720830:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 4 00000100:00100000:0.0:1789445866.720921:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445866.721023:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722084992 00000100:00100000:0.0:1789445866.721027:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722084992 00000100:00100000:0.0:1789445866.721081:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 17 00000100:00100000:0.0:1789445866.721088:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:10457:x1876369722084992:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:0.0:1789445866.721272:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:10457:x1876369722084992:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 183us (350us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789445866.721278:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 17 00000100:00100000:0.0:1789445866.948175:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445866.948265:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722085248 00000100:00100000:3.0:1789445866.948273:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722085248 00000100:00100000:3.0:1789445866.948331:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 64 00000100:00100000:3.0:1789445866.948340:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:10475:x1876369722085248:12345-192.168.206.59@tcp:101:cat.0 00010000:00010000:3.0:1789445866.948362:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445866.948381:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472565a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4bdf expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445866.948511:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472565ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445866.948526:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472565ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445866.948537:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472565ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445866.948548:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789445866.948665:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472565a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bdf expref: 24 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445866.948685:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472565ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bdf expref: 23 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445866.948694:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:3.0:1789445866.948697:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789445866.948701:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fce00, rc 0) 00000100:00100000:3.0:1789445866.948764:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:10475:x1876369722085248:12345-192.168.206.59@tcp:101:cat.0 Request processed in 424us (598us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789445866.948771:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 64 00000100:00100000:2.0:1789445866.980840:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445866.980973:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722085376 00000100:00100000:0.0:1789445866.980982:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722085376 00000100:00100000:0.0:1789445866.981035:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 65 00000100:00100000:0.0:1789445866.981066:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:10476:x1876369722085376:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:0.0:1789445866.981087:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445866.981105:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472565bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4be6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.981160:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472565c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.981173:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472565c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.981185:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472565c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445866.981215:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789445866.981218:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789445866.981233:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472565c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.981257:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472565bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4be6 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.981297:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472565c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4be6 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445866.981306:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:0.0:1789445866.981308:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789445866.981312:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906800, rc 0) 00000100:00100000:0.0:1789445866.981376:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:10476:x1876369722085376:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 333us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445866.981383:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 65 00000100:00100000:1.0:1789445866.987600:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445866.987675:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722085760 00000100:00100000:3.0:1789445866.987685:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722085760 00000100:00100000:3.0:1789445866.987730:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 18 00000100:00100000:3.0:1789445866.987738:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:10476:x1876369722085760:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:3.0:1789445866.988018:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+25:10476:x1876369722085760:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 280us (425us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789445866.988037:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 18 00000100:00100000:2.0:1789445866.993703:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445866.993806:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722085888 00000100:00100000:1.0:1789445866.993815:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722085888 00000100:00100000:1.0:1789445866.993893:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 5 00000100:00100000:1.0:1789445866.993904:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+25:10476:x1876369722085888:12345-192.168.206.59@tcp:103:lfs.0 00010000:00010000:1.0:1789445866.993919:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789445866.993942:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256553 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bca expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.993963:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472565ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bdf expref: 24 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.993976:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256457 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b8b expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445866.993986:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:1.0:1789445866.993995:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445866.994091:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+22:10476:x1876369722085888:12345-192.168.206.59@tcp:103:lfs.0 Request processed in 189us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445866.994098:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 5 00000100:00100000:2.0:1789445867.000803:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445867.000881:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722086016 00000100:00100000:3.0:1789445867.000890:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722086016 00000100:00100000:3.0:1789445867.000955:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 66 00000100:00100000:3.0:1789445867.000964:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+22:10476:x1876369722086016:12345-192.168.206.59@tcp:58:lfs.0 00010000:00010000:3.0:1789445867.001100:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472565ca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445867.001116:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472565ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445867.001128:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472565ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789445867.001434:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789445867.001912:0:8204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789445867.002112:0:8204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1789445867.002167:0:8204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1789445867.002275:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+22:10476:x1876369722086016:12345-192.168.206.59@tcp:58:lfs.0 Request processed in 1310us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445867.002284:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 66 00000100:00100000:2.0:1789445867.040382:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445867.040545:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722086144 00000100:00100000:0.0:1789445867.040555:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722086144 00000100:00100000:0.0:1789445867.040619:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 67 00000100:00100000:0.0:1789445867.040629:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+22:10478:x1876369722086144:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:0.0:1789445867.040651:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445867.040672:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472565d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4bed expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.040734:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472565d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.040746:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472565d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.040756:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472565d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.040788:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906600/0xc1b37c4d472565df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.040796:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906600/0xc1b37c4d472565df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.040803:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906600/0xc1b37c4d472565df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041017:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472565e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041027:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472565e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041034:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472565e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445867.041108:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789445867.041113:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789445867.041131:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472565e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041143:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472565e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041151:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472565d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041158:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472565d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041176:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472565d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041182:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445867.041186:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472565d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041194:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472565d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041207:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:0.0:1789445867.041210:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445867.041215:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472565d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041222:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d472565d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041234:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906600/0xc1b37c4d472565df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041241:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906600/0xc1b37c4d472565df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041247:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906600/0xc1b37c4d472565df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041253:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445867.041256:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906600/0xc1b37c4d472565df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041272:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906600/0xc1b37c4d472565df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041280:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe98961100) 00010000:00010000:0.0:1789445867.041283:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445867.041285:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906600/0xc1b37c4d472565df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041290:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906600/0xc1b37c4d472565df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041321:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472565d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bed expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041335:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472565e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bed expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445867.041342:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe8e97ae00) 00010000:00010000:0.0:1789445867.041344:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789445867.041346:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907e00, rc 0) 00000100:00100000:0.0:1789445867.041423:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:10478:x1876369722086144:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 795us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445867.041430:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 67 00000100:00100000:2.0:1789445867.045498:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445867.045534:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445867.045560:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445867.045649:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722086272 00000100:00100000:3.0:1789445867.045658:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722086272 00000100:00100000:0.0:1789445867.045703:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722086528 00000100:00100000:0.0:1789445867.045709:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722086528 00000100:00100000:3.0:1789445867.045714:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 283 00000100:00100000:3.0:1789445867.045726:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2376:x1876369722086272:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445867.045760:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 125 00000100:00100000:0.0:1789445867.045771:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2376:x1876369722086528:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445867.045802:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2376:x1876369722086272:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 67us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445867.045811:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 283 00000100:00100000:0.0:1789445867.045828:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2376:x1876369722086528:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 58us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445867.045837:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 125 00000100:00080000:0.0:1789445867.045861:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789445867.046544:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722086400 00000100:00100000:1.0:1789445867.046550:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722086400 00000100:00100000:1.0:1789445867.046592:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 70 00000100:00100000:1.0:1789445867.046600:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2377:x1876369722086400:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445867.046632:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2377:x1876369722086400:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 33us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445867.046638:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 70 00000100:00080000:0.0:1789445867.047853:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789445867.227184:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789445867.996319:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789445867.996329:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789445867.996380:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789445867.996387:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789445867.996518:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a304700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1876369742035456:192.168.206.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789445867.996621:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91ad8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789445868.001777:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a304700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1876369742035456:192.168.206.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789445868.002326:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445868.002387:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722086656 00000100:00100000:0.0:1789445868.002394:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722086656 00000100:00100000:0.0:1789445868.002440:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 1 00000100:00100000:0.0:1789445868.002460:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:10489:x1876369722086656:12345-192.168.206.59@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789445868.002539:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:10489:x1876369722086656:12345-192.168.206.59@tcp:900:lhsmtool_posix.0 Request processed in 92us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445868.002547:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 1 00000100:00100000:3.0:1789445868.008184:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445868.008263:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722086784 00000100:00100000:1.0:1789445868.008272:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722086784 00000100:00100000:1.0:1789445868.008327:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 68 00000100:00100000:1.0:1789445868.008342:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:10489:x1876369722086784:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789445868.008373:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789445868.008469:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:10489:x1876369722086784:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 Request processed in 129us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445868.008477:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 68 00000040:00080000:0.0:1789445868.015308:0:11993:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789445868.015316:0:11993:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789445868.015347:0:11993:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789445868.015353:0:11993:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789445868.018033:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445868.018699:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722086912 00000100:00100000:3.0:1789445868.018709:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722086912 00000100:00100000:3.0:1789445868.018761:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 69 00000100:00100000:3.0:1789445868.018771:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:10489:x1876369722086912:12345-192.168.206.59@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789445868.018858:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472565ed lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.018877:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472565ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.018890:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472565ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.018990:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472565f4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.018998:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472565f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.019006:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472565f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.019042:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d472565fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.019074:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d472565fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.019081:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d472565fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445868.019726:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789445868.019731:0:8204:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789445868.019746:0:8204:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d472565fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.019757:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472565ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.019764:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472565ed lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.019771:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472565ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.019777:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fce00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445868.019834:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472565ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.019843:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472565ed lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.019855:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afe858f5c00) 00010000:00010000:3.0:1789445868.019865:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445868.019870:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472565ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.019876:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d472565ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.019890:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472565f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.019897:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472565f4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.020013:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472565f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.020019:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445868.020021:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472565f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.020028:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472565f4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.020036:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9afe8e97a900) 00010000:00010000:3.0:1789445868.020039:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445868.020041:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472565f4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.020071:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472565f4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.020317:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d472565fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.020330:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d472565fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.020335:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d472565fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.020341:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fde00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445868.020344:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d472565fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.020350:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d472565fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.020358:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe8e97ae00) 00010000:00010000:3.0:1789445868.020360:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445868.020363:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d472565fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.020369:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d472565fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445868.020459:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:10489:x1876369722086912:12345-192.168.206.59@tcp:34:lhsmtool_posix.0 Request processed in 1674us (2420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445868.020468:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 69 00000100:00100000:3.0:1789445868.024389:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445868.025867:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722087168 00000100:00100000:2.0:1789445868.025878:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722087168 00000100:00100000:2.0:1789445868.025935:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 70 00000100:00100000:2.0:1789445868.025945:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:10489:x1876369722087168:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789445868.025964:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445868.025984:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256602 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4bf4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.026094:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256609 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.026108:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.026129:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445868.026140:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789445868.026330:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.026338:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256609 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.026345:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256609 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.026351:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445868.026356:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256609 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.026363:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256609 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.026375:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe8e97ae00) 00010000:00010000:2.0:1789445868.026378:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789445868.026383:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256609 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.026389:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256609 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.026427:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256602 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bf4 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.026466:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afe858f5c00) 00010000:00010000:2.0:1789445868.026468:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789445868.026473:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256602 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bf4 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.026483:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bfc00, rc 0) 00000100:00100000:2.0:1789445868.026542:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:10489:x1876369722087168:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 598us (2162us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1789445868.026549:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 70 00000100:00100000:3.0:1789445868.031007:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445868.031872:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722087296 00000100:00100000:0.0:1789445868.031882:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722087296 00000100:00100000:0.0:1789445868.032002:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 71 00000100:00100000:0.0:1789445868.032015:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:10489:x1876369722087296:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789445868.032065:0:8204:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789445868.032223:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:10489:x1876369722087296:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 Request processed in 211us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445868.032230:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 71 00000100:00100000:0.0:1789445868.045183:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445868.045242:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722087552 00000100:00100000:1.0:1789445868.045252:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722087552 00000100:00100000:1.0:1789445868.045300:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 72 00000100:00100000:1.0:1789445868.045309:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:10489:x1876369722087552:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789445868.045327:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445868.045329:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789445868.045354:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d472565c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4be6 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445868.045370:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:1.0:1789445868.045376:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789445868.045387:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256617 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4bfb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789445868.045921:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789445868.046174:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d4725661e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445868.046187:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d4725661e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445868.046198:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d4725661e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.047109:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256617 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bfb expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.047132:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d4725661e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bfb expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.047149:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:3.0:1789445868.047152:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789445868.047155:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6fe00, rc 0) 00000100:00100000:3.0:1789445868.047222:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+25:10489:x1876369722087552:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 1913us (2046us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789445868.047232:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 72 00000100:00100000:0.0:1789445868.059081:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445868.059651:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722087808 00000100:00100000:3.0:1789445868.059660:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722087808 00000100:00100000:3.0:1789445868.059716:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 73 00000100:00100000:3.0:1789445868.059726:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+25:10489:x1876369722087808:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789445868.059774:0:8204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445868.059796:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d4725661e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bfb expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.059810:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9afe858f5700) 00010000:00010000:3.0:1789445868.059819:0:8204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789445868.059836:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d4725662c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.059849:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d4725662c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.059857:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d4725662c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.059870:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256633 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7656701 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.059888:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256633 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7656701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.059895:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256633 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7656701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.060085:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d4725662c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.060093:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d4725662c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.060100:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d4725662c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.060105:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fde00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445868.060109:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d4725662c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.060117:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d4725662c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.060125:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:3.0:1789445868.060128:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445868.060132:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d4725662c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.060138:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d4725662c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.060147:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256633 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7656701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.060158:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256633 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7656701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.060164:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256633 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7656701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.060169:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445868.060172:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256633 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7656701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.060178:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256633 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7656701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.060186:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7656701 (ffff9afe8e97a900) 00010000:00010000:3.0:1789445868.060188:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445868.060191:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256633 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7656701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.060197:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256633 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7656701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445868.061238:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:10489:x1876369722087808:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 Request processed in 1508us (2161us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789445868.061247:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 73 00000100:00100000:3.0:1789445868.075516:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445868.075606:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722087936 00000100:00100000:0.0:1789445868.075615:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722087936 00000100:00100000:0.0:1789445868.075670:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 74 00000100:00100000:0.0:1789445868.075679:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:10489:x1876369722087936:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789445868.075698:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445868.075718:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d4725663a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c02 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.075749:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256641 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.075762:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.075773:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.075855:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d4725663a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c02 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.075871:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256641 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c02 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.075879:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9afe98961100) 00010000:00010000:0.0:1789445868.075881:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789445868.075885:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907c00, rc 0) 00000100:00100000:0.0:1789445868.075950:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+25:10489:x1876369722087936:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 272us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445868.075962:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 74 00000100:00100000:1.0:1789445868.096783:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445868.097141:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722088192 00000100:00100000:3.0:1789445868.097151:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722088192 00000100:00100000:3.0:1789445868.097748:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 75 00000100:00100000:3.0:1789445868.097807:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+25:10489:x1876369722088192:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789445868.097895:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256648 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.097912:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256648 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.097924:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256648 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789445868.098206:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1789445868.098215:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306120169039ns, next at 307120166879ns, rc = 0 00000004:00010000:3.0:1789445868.098287:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a23b123 reply state 00000000ec7c971f transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256648 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445868.098296:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789445868.098385:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+27:10489:x1876369722088192:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 Request processed in 627us (1610us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1789445868.098393:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 75 00000100:00100000:0.0:1789445868.110744:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00010000:00010000:3.0:1789445868.117944:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256648 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.117961:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256648 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.117969:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256648 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.117976:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445868.117981:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256648 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.118002:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256648 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.118017:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9afe98961100) 00010000:00010000:3.0:1789445868.118020:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789445868.118025:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256648 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.118032:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256648 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445868.119578:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722088320 00000100:00100000:0.0:1789445868.119589:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722088320 00000100:00100000:0.0:1789445868.119638:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 76 00000100:00100000:0.0:1789445868.119647:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+27:10489:x1876369722088320:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789445868.119668:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445868.119685:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d4725664f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c09 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.119735:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d4725664f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c09 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.119748:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d4725664f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c09 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.120119:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9afe98961100) 00010000:00010000:0.0:1789445868.120123:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789445868.120127:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907000, rc 0) 00000100:00100000:0.0:1789445868.120180:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+28:10489:x1876369722088320:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 534us (9446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445868.120187:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 76 00000100:00100000:1.0:1789445868.128950:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445868.130864:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722088448 00000100:00100000:3.0:1789445868.130876:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722088448 00000100:00100000:3.0:1789445868.130925:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 25 00000100:00100000:3.0:1789445868.130933:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2373:x1876369722088448:12345-192.168.206.59@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789445868.130963:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:3.0:1789445868.130991:0:6684:0:(genops.c:1384:class_connect()) connect: client 4a94602d-5f10-4cb2-abf8-c0de02603d85, cookie 0xc1b37c4d47256656 00002000:00100000:3.0:1789445868.131002:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4a94602d-5f10-4cb2-abf8-c0de02603d85/ffff9afeb57d3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789445868.131024:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789445868.131387:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789445868.131418:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9afeb57d4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789445868.131498:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2373:x1876369722088448:12345-192.168.206.59@tcp:8:lhsmtool_posix.0 Request processed in 565us (2558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445868.131507:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 25 00000100:00100000:1.0:1789445868.134463:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445868.134524:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722088576 00000100:00100000:2.0:1789445868.134532:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722088576 00000100:00080000:3.0:1789445868.134587:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789445868.134605:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 26 00000100:00100000:2.0:1789445868.134615:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:0:x1876369722088576:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 00000001:00080000:2.0:1789445868.204951:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:2.0:1789445868.204967:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4a94602d-5f10-4cb2-abf8-c0de02603d85 00000100:00100000:1.0:1789445868.205635:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:0:x1876369722088576:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 Request processed in 71015us (71184us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789445868.205646:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 26 00000100:00100000:0.0:1789445868.209292:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445868.209395:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722088832 00000100:00100000:2.0:1789445868.209405:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722088832 00000100:00100000:2.0:1789445868.209470:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 19 00000100:00100000:2.0:1789445868.209481:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+27:10489:x1876369722088832:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789445868.209710:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+28:10489:x1876369722088832:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 Request processed in 231us (559us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789445868.209718:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 19 00000100:00100000:3.0:1789445868.232920:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445868.232994:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722089088 00000100:00100000:1.0:1789445868.233003:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722089088 00000100:00100000:1.0:1789445868.233080:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 77 00000100:00100000:1.0:1789445868.233090:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+28:10489:x1876369722089088:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789445868.233195:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+28:10489:x1876369722089088:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 Request processed in 106us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445868.233202:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 77 00000100:00100000:1.0:1789445868.240850:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445868.240978:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722089216 00000100:00100000:0.0:1789445868.240989:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722089216 00000100:00100000:0.0:1789445868.241084:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 78 00000100:00100000:0.0:1789445868.241097:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+28:10489:x1876369722089216:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789445868.241126:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445868.241149:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d4725665d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c10 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.241247:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256664 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.241262:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256664 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.241275:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256664 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445868.241310:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789445868.241328:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256664 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.242492:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d4725665d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c10 expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.242515:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256664 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c10 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.242525:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9afe98961100) 00010000:00010000:0.0:1789445868.242528:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789445868.242531:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907600, rc 0) 00000100:00100000:0.0:1789445868.242599:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+29:10489:x1876369722089216:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 1505us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445868.242608:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 78 00000100:00100000:3.0:1789445868.246842:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445868.246934:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722089344 00000100:00100000:1.0:1789445868.246943:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722089344 00000100:00100000:1.0:1789445868.246993:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 27 00000100:00100000:1.0:1789445868.247003:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2376:x1876369722089344:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789445868.247020:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445868.247036:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e21c782c/0xc1b37c4d4725666b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c17 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789445868.247085:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa8c6ec, blocks: 0x1 00010000:00010000:1.0:1789445868.247102:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=306s v=(0 0) 00010000:00010000:1.0:1789445868.247106:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445868.247120:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e21c782c/0xc1b37c4d4725666b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c17 expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445868.247139:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e21c782c/0xc1b37c4d4725666b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c17 expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445868.247151:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6f800, rc 0) 00000100:00100000:1.0:1789445868.247194:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2376:x1876369722089344:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 193us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445868.247201:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 27 00010000:00010000:2.0:1789445868.251160:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445868.252786:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445868.252910:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722089600 00000100:00100000:2.0:1789445868.252929:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722089600 00000100:00100000:2.0:1789445868.252981:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 79 00000100:00100000:2.0:1789445868.252990:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+29:10489:x1876369722089600:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789445868.253103:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+29:10489:x1876369722089600:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 Request processed in 114us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445868.253111:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 79 00000100:00100000:3.0:1789445868.257707:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445868.259245:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722089728 00000100:00100000:1.0:1789445868.259258:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722089728 00000100:00100000:1.0:1789445868.259309:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 28 00000100:00100000:1.0:1789445868.259319:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:10489:x1876369722089728:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789445868.259350:0:11692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445868.259372:0:11692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000096313b1/0xc1b37c4d47256672 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c1e expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445868.259405:0:11692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e21c782c/0xc1b37c4d4725666b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c17 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445868.259415:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445868.259420:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445868.259426:0:11692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000096313b1/0xc1b37c4d47256672 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c1e expref: 7 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445868.259472:0:11692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e21c782c/0xc1b37c4d4725666b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c17 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445868.259497:0:11692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e21c782c/0xc1b37c4d4725666b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c17 expref: 7 pid: 6685 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445868.259513:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb2a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11692:1876369742035584:192.168.206.59@tcp:104: 00000100:00100000:1.0:1789445868.259595:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe82bbdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445868.264585:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445868.266329:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb2a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11692:1876369742035584:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789445868.266368:0:11692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000096313b1/0xc1b37c4d47256672 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c1e expref: 7 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445868.266388:0:11692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6fa00, rc 0) 00000100:00100000:1.0:1789445868.266461:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:10489:x1876369722089728:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 7142us (8761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445868.266470:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 28 00000100:00100000:3.0:1789445868.266922:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722089856 00000100:00100000:3.0:1789445868.266931:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722089856 00010000:00010000:3.0:1789445868.266961:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e21c782c/0xc1b37c4d4725666b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c17 expref: 7 pid: 6685 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445868.267003:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 42 00000100:00100000:3.0:1789445868.267012:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe919b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2374:x1876369722089856:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445868.267024:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445868.267065:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e21c782c/0xc1b37c4d4725666b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c17 expref: 7 pid: 6685 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.267078:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e21c782c/0xc1b37c4d4725666b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c17 expref: 7 pid: 6685 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.267101:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e21c782c/0xc1b37c4d4725666b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c17 expref: 7 pid: 6685 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.267116:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445868.267121:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445868.267128:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000096313b1/0xc1b37c4d47256672 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c1e expref: 6 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.267139:0:7627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000096313b1/0xc1b37c4d47256672 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c1e expref: 6 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.267184:0:7627:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000096313b1/0xc1b37c4d47256672 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c1e expref: 6 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445868.267198:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba0f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7627:1876369742035712:192.168.206.59@tcp:105: 00000100:00100000:3.0:1789445868.267248:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896bb900 going to sleep for 11 seconds 00000100:00100000:3.0:1789445868.272897:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba0f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7627:1876369742035712:192.168.206.59@tcp:105: 00010000:00010000:3.0:1789445868.272922:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445868.272982:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe919b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2374:x1876369722089856:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 5970us (8405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445868.272992:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 42 00000100:00100000:3.0:1789445868.281613:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445868.281755:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722089984 00000100:00100000:0.0:1789445868.281766:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722089984 00002000:00100000:0.0:1789445868.281883:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9afeba0f1880 x1876369722089984/t0(0) o4->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:749/0 lens 504/0 e 0 to 0 dl 1789445879 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789445868.281895:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afeba0f1880 with x1876369722089984 ext(0->8) 00002000:00010000:0.0:1789445868.281901:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afeba0f1880 00000100:00100000:0.0:1789445868.281932:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 0 00000100:00100000:0.0:1789445868.281942:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2374:x1876369722089984:12345-192.168.206.59@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789445868.286923:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2374:x1876369722089984:12345-192.168.206.59@tcp:4:lhsmtool_posix.0 Request processed in 4976us (5312us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789445868.286937:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 0 00002000:00100000:0.0:1789445868.286949:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9afeba0f1880 x1876369722089984/t4294967302(0) o4->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:749/0 lens 504/448 e 0 to 0 dl 1789445879 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789445868.286960:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afeba0f1880 with x1876369722089984 ext(0->8) 00002000:00010000:0.0:1789445868.286965:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afeba0f1880 00000100:00100000:0.0:1789445868.300538:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445868.300615:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722090112 00000100:00100000:1.0:1789445868.300626:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722090112 00000100:00100000:1.0:1789445868.300782:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 80 00000100:00100000:1.0:1789445868.300878:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+29:10489:x1876369722090112:12345-192.168.206.59@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789445868.352835:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000001:00080000:0.0:1789445868.352877:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000020:00080000:0.0:1789445868.352890:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1789445868.352903:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1789445868.352913:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:0.0:1789445868.353003:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1789445868.353017:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:3.0:1789445868.353176:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789445868.353194:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba0f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742035840:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789445868.353266:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445868.353365:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742035840 00000100:00100000:0.0:1789445868.353373:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742035840 00000100:00100000:2.0:1789445868.353431:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:10489:x1876369722090112:12345-192.168.206.59@tcp:44:lhsmtool_posix.0 Request processed in 52637us (52897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445868.353436:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789445868.353463:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 80 00000100:00100000:0.0:1789445868.353463:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742035840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789445868.353615:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789445868.353619:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789445868 00002000:00010000:0.0:1789445868.353621:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789445868.353624:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789445868 -> 1789445868 00002000:00010000:0.0:1789445868.353627:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:3.0:1789445868.353640:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789445868.353672:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876369742035840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 214us (418us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789445868.353680:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1789445868.354006:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afeba0f2a00/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789445868.354013:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba0f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742035840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789445868.356200:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445868.356700:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722090240 00000100:00100000:3.0:1789445868.356709:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722090240 00000100:00100000:3.0:1789445868.356760:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 30 00000100:00100000:3.0:1789445868.356769:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2375:x1876369722090240:12345-192.168.206.59@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789445868.385111:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1789445868.385126:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1789445868.385420:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2375:x1876369722090240:12345-192.168.206.59@tcp:16:lhsmtool_posix.0 Request processed in 28646us (29221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445868.385433:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 30 00000100:00100000:3.0:1789445868.387934:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445868.388105:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722090496 00000100:00100000:2.0:1789445868.388113:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722090496 00000100:00100000:2.0:1789445868.388191:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 81 00000100:00100000:2.0:1789445868.388201:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:10489:x1876369722090496:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789445868.388255:0:8204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445868.388283:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256664 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c10 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.388300:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9afe98961100) 00010000:00010000:2.0:1789445868.388305:0:8204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789445868.388329:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256679 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.388343:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256679 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.388365:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256679 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789445868.388604:0:8204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b64fd1cd reply state 000000005f875b8e transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256679 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445868.388613:0:8204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789445868.388738:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:10489:x1876369722090496:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 Request processed in 539us (811us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789445868.388746:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 81 00000100:00100000:1.0:1789445868.391123:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445868.391152:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722090624 00000100:00100000:1.0:1789445868.391167:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722090624 00000100:00100000:1.0:1789445868.391207:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 31 00000100:00100000:1.0:1789445868.391215:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2375:x1876369722090624:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 00010000:00010000:3.0:1789445868.391811:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256679 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.391827:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256679 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.391834:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256679 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.391841:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445868.391846:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256679 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.391853:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256679 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.391866:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9afe98961100) 00010000:00010000:3.0:1789445868.391868:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445868.391873:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256679 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.391879:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256679 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789445868.392137:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789445868.392141:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789445868 -> 1789445866 00002000:00010000:1.0:1789445868.392143:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789445864 00002000:00010000:1.0:1789445868.392145:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789445868 -> 1789445866 00002000:00010000:1.0:1789445868.392147:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789445868.392192:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2375:x1876369722090624:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 Request processed in 976us (1074us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789445868.392199:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 31 00000100:00100000:1.0:1789445868.394427:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445868.394521:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722090880 00000100:00100000:0.0:1789445868.394529:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722090880 00000100:00100000:0.0:1789445868.394600:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 82 00000100:00100000:0.0:1789445868.394609:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:10489:x1876369722090880:12345-192.168.206.59@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789445868.394664:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256680 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.394680:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256641 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c02 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.394689:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256680 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.394718:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256641 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c02 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.394732:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256641 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c02 expref: 13 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445868.394746:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742035968:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445868.394841:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea485b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789445868.398486:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445868.398645:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742035968:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789445868.398671:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256680 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445868.398731:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722091008 00000100:00100000:2.0:1789445868.398737:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722091008 00010000:00010000:2.0:1789445868.398768:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256641 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c02 expref: 14 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445868.398812:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 43 00000100:00100000:2.0:1789445868.398820:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:2374:x1876369722091008:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445868.398834:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445868.398840:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256641 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c02 expref: 14 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.398852:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256641 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c02 expref: 14 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.398871:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256641 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c02 expref: 14 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.398900:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9afe98961100) 00010000:00010000:2.0:1789445868.398905:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256680 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.398913:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.398921:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256680 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.398945:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445868.398990:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:2374:x1876369722091008:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 170us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445868.398997:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 43 00010000:00010000:0.0:1789445868.399377:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.399386:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.399421:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.399429:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256680 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.399435:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256680 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.399442:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445868.399454:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256680 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.399461:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256680 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.399470:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9afe98961100) 00010000:00010000:0.0:1789445868.399473:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789445868.399477:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256680 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.399495:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256680 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445868.399542:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+12:10489:x1876369722090880:12345-192.168.206.59@tcp:55:lhsmtool_posix.0 Request processed in 4935us (5121us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789445868.399550:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 82 00000100:00100000:1.0:1789445868.403039:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445868.403152:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722091136 00000100:00100000:2.0:1789445868.403161:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722091136 00000100:00100000:2.0:1789445868.403208:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 32 00000100:00100000:2.0:1789445868.403216:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2374:x1876369722091136:12345-192.168.206.59@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789445868.403270:0:11692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d47256687 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.403290:0:11692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000096313b1/0xc1b37c4d47256672 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c1e expref: 7 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.403298:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445868.403303:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789445868.403307:0:11692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d47256687 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.403347:0:11692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000096313b1/0xc1b37c4d47256672 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c1e expref: 7 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.403361:0:11692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000096313b1/0xc1b37c4d47256672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c1e expref: 7 pid: 11692 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445868.403376:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11692:1876369742036096:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445868.403456:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe90c51240 going to sleep for 11 seconds 00000100:00100000:1.0:1789445868.406670:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445868.406757:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11692:1876369742036096:192.168.206.59@tcp:104: 00010000:00010000:2.0:1789445868.406792:0:11692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d47256687 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445868.406850:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722091264 00000100:00100000:3.0:1789445868.406857:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722091264 00010000:00010000:3.0:1789445868.406894:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000096313b1/0xc1b37c4d47256672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c1e expref: 8 pid: 11692 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445868.406930:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 44 00000100:00100000:3.0:1789445868.406939:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2375:x1876369722091264:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445868.406952:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445868.406990:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000096313b1/0xc1b37c4d47256672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c1e expref: 8 pid: 11692 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.407004:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000096313b1/0xc1b37c4d47256672 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c1e expref: 8 pid: 11692 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.407026:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000096313b1/0xc1b37c4d47256672 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c1e expref: 8 pid: 11692 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.407079:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789445868.407085:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789445868.407090:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d47256687 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.407101:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d47256687 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.407124:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445868.407169:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2375:x1876369722091264:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 230us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445868.407176:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 44 00010000:00010000:2.0:1789445868.407611:0:11692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d47256687 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.407622:0:11692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d47256687 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.407645:0:11692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d47256687 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.407654:0:11692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d47256687 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.407673:0:11692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d47256687 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.407680:0:11692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445868.407684:0:11692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d47256687 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.407693:0:11692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d47256687 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.407704:0:11692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d47256687 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.407711:0:11692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d47256687 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445868.407757:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2374:x1876369722091136:12345-192.168.206.59@tcp:1:lhsmtool_posix.0 Request processed in 4542us (4725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445868.407764:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 32 00000100:00100000:1.0:1789445868.410746:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445868.410831:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722091520 00000100:00100000:0.0:1789445868.410840:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722091520 00000100:00100000:0.0:1789445868.410888:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 83 00000100:00100000:0.0:1789445868.410897:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+12:10489:x1876369722091520:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789445868.410963:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d4725668e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.410979:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d4725668e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.410989:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d4725668e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.411199:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256695 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.411210:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d4725664f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c09 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.411219:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256695 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.411499:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d4725664f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c09 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.411526:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d4725664f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c09 expref: 13 pid: 5841 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445868.411540:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742036224:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445868.411608:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea485b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789445868.414505:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742036224:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789445868.414532:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256695 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445868.415708:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445868.415922:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722091648 00000100:00100000:2.0:1789445868.415929:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722091648 00010000:00010000:2.0:1789445868.415961:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d4725664f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c09 expref: 14 pid: 5841 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445868.415997:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 45 00000100:00100000:2.0:1789445868.416018:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:2374:x1876369722091648:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445868.416074:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445868.416082:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d4725664f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c09 expref: 14 pid: 5841 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.416095:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d4725664f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c09 expref: 14 pid: 5841 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.416115:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d4725664f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c09 expref: 14 pid: 5841 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.416132:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9afe98961100) 00010000:00010000:2.0:1789445868.416138:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256695 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.416147:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256695 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.416154:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256695 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.416175:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445868.416226:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:2374:x1876369722091648:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 209us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445868.416233:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 45 00010000:00010000:0.0:1789445868.416670:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256695 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.416679:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256695 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789445868.416848:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1789445868.416974:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1789445868.417011:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1789445868.417109:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876369742036352:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789445868.417149:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445868.417174:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea485b780 going to sleep for 11 seconds 00000100:00100000:3.0:1789445868.417245:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742036352 00000100:00100000:3.0:1789445868.417256:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742036352 00000100:00100000:3.0:1789445868.417297:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789445868.417304:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876369742036352:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789445868.417367:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876369742036352:12345-0@lo:1000:mdt00_000.0 Request processed in 63us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445868.417374:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789445868.417554:0:5840:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1789445868.417560:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afeba0f2a00, transno 4294967303 00000100:00100000:2.0:1789445868.417568:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876369742036352:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789445868.417930:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1789445868.417973:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876369742036480:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789445868.418006:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445868.418022:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8925e300 going to sleep for 11 seconds 00000100:00100000:2.0:1789445868.418037:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742036480 00000100:00100000:2.0:1789445868.418040:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742036480 00000100:00100000:2.0:1789445868.418079:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789445868.418085:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876369742036480:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789445868.418201:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1876369742036480:12345-0@lo:1000:mdt00_000.0 Request processed in 115us (193us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789445868.418208:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789445868.418550:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876369742036480:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789445868.418574:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256695 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418583:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256695 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418590:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256695 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418596:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445868.418600:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256695 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418607:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256695 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418618:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9afe98961100) 00010000:00010000:2.0:1789445868.418626:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789445868.418631:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256695 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418638:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256695 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418667:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472565ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418674:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472565ca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418680:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472565ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418686:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fd200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445868.418688:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472565ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418693:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472565ca lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418701:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe8e97ae00) 00010000:00010000:2.0:1789445868.418703:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789445868.418706:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472565ca lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418712:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d472565ca lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418730:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725669c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418751:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472565e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bed expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418760:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725669c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418781:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472565e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bed expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.418792:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472565e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bed expref: 16 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445868.418802:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffa4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742036608:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445868.419019:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afead8223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445868.423504:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445868.423622:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffa4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742036608:192.168.206.59@tcp:104: 00010000:00010000:2.0:1789445868.423646:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725669c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445868.423701:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722091776 00000100:00100000:3.0:1789445868.423708:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722091776 00010000:00010000:3.0:1789445868.423739:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472565e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bed expref: 17 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445868.423770:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 46 00000100:00100000:3.0:1789445868.423777:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+17:2375:x1876369722091776:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445868.423798:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445868.423804:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472565e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bed expref: 17 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.423817:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472565e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bed expref: 17 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.423836:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472565e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4bed expref: 17 pid: 5842 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.423851:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe8e97ae00) 00010000:00010000:3.0:1789445868.423856:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725669c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.423865:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725669c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.423889:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725669c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445868.423916:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445868.423968:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+16:2375:x1876369722091776:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 191us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445868.423975:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 46 00010000:00010000:2.0:1789445868.424330:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725669c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.424339:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725669c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.424350:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725669c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.424356:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725669c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.424370:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725669c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.424376:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445868.424380:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725669c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.424388:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725669c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.424397:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe8e97ae00) 00010000:00010000:2.0:1789445868.424400:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445868.424403:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725669c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.424408:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d4725669c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.424431:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d4725668e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.424441:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d4725668e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.424456:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d4725668e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.424461:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445868.424464:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d4725668e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.424479:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d4725668e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.424487:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe8e97ae00) 00010000:00010000:2.0:1789445868.424490:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789445868.424492:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d4725668e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445868.424498:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d4725668e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445868.424686:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:10489:x1876369722091520:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 Request processed in 13789us (13946us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789445868.424695:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 83 00000020:00080000:2.0:1789445868.424699:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789445868.424902:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789445868.424907:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789445868.424930:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789445868.424935:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789445868.428513:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445868.428541:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722092032 00000100:00100000:0.0:1789445868.428551:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722092032 00000100:00100000:0.0:1789445868.428607:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 20 00000100:00100000:0.0:1789445868.428681:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:10489:x1876369722092032:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789445868.429678:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789445868.429776:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1789445868.429820:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d472566a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445868.429834:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d472566a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445868.429845:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d472566a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445868.429860:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d472566a3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445868.429867:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d472566a3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445868.429873:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d472566a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445868.429932:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789445868.430022:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+17:10489:x1876369722092032:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 Request processed in 1404us (1516us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789445868.430029:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 20 00000020:00080000:1.0:1789445868.430034:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789445868.430670:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445868.430678:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d472566a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.430691:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6ec00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445868.430695:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d472566a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.430704:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d472566a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.430715:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9afe858f5000) 00010000:00010000:0.0:1789445868.430718:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789445868.430722:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d472566a3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.430728:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d472566a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445868.430745:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445868.430746:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445868.430748:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445868.634331:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876369742036992:0@lo:400:kworker.0 00000100:00100000:2.0:1789445868.634412:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445868.634482:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789445868.634488:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876369742036864:0@lo:400:kworker.0 00000100:00100000:2.0:1789445868.634510:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445868.634538:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742036992 00000100:00100000:2.0:1789445868.634545:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742036992 00000100:00100000:2.0:1789445868.634585:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742036864 00000100:00100000:2.0:1789445868.634588:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742036864 00000100:00100000:2.0:1789445868.634605:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789445868.634612:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876369742036992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445868.634665:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876369742036992:12345-0@lo:400:kworker.0 Request processed in 42us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445868.634695:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789445868.634711:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789445868.634716:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876369742036864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445868.634742:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876369742036864:12345-0@lo:400:kworker.0 Request processed in 26us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445868.634747:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1789445868.634761:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445868.634785:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876369742036864:0@lo:400:kworker.0 00000100:00100000:2.0:1789445868.634804:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876369742036992:0@lo:400:kworker.0 00000100:00100000:3.0:1789445868.635578:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742036736:0@lo:400:kworker.0 00000100:00100000:3.0:1789445868.635624:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445868.635676:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742037248:0@lo:400:kworker.0 00000100:00100000:3.0:1789445868.635699:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445868.635723:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789445868.635729:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742037120:0@lo:400:kworker.0 00000100:00100000:3.0:1789445868.635748:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445868.635971:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742037120 00000100:00100000:1.0:1789445868.635977:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742037120 00000100:00100000:1.0:1789445868.636025:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789445868.636032:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1876369742037120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445868.636095:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1876369742037120:12345-0@lo:400:kworker.0 Request processed in 63us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445868.636102:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789445868.636134:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742037120:0@lo:400:kworker.0 00000100:00100000:1.0:1789445868.636153:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742037248 00000100:00100000:1.0:1789445868.636155:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742037248 00000100:00100000:1.0:1789445868.636178:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789445868.636183:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742037248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445868.636212:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742037248:12345-0@lo:400:kworker.0 Request processed in 29us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445868.636227:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789445868.636264:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742037248:0@lo:400:kworker.0 00000100:00080000:3.0:1789445868.637244:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789445868.637250:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789445868.637581:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742036736 00000100:00100000:2.0:1789445868.637589:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742036736 00000100:00100000:2.0:1789445868.637631:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789445868.637639:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742036736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445868.637964:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742036736:12345-0@lo:400:kworker.0 Request processed in 325us (2339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445868.637972:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789445868.638231:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742036736:0@lo:400:kworker.0 00000100:00100000:2.0:1789445869.148488:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789445869.148513:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba0f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742037376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789445869.148577:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445869.148690:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742037376 00000100:00100000:3.0:1789445869.148706:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742037376 00000100:00100000:3.0:1789445869.148754:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789445869.148763:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876369742037376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789445869.148786:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1789445869.148843:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876369742037376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445869.149466:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba0f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742037376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789445869.150085:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:0.0:1789445869.281036:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789445869.697645:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:1.0:1789445869.697770:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:1.0:1789445869.697776:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000040:00080000:0.0:1789445869.953007:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789445869.953016:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789445869.953265:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789445869.953272:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789445870.205551:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445870.205582:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722092288 00000100:00100000:3.0:1789445870.205599:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722092288 00000100:00100000:3.0:1789445870.205654:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 84 00000100:00100000:3.0:1789445870.205664:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+17:10508:x1876369722092288:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445870.205687:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445870.205705:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472566aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c25 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.205789:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d472566b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.205803:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d472566b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.205815:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d472566b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445870.205825:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789445870.205920:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d472566aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c25 expref: 20 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.205936:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d472566b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c25 expref: 19 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.205944:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:3.0:1789445870.205946:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789445870.205950:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fde00, rc 0) 00000100:00100000:3.0:1789445870.206001:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:10508:x1876369722092288:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 339us (458us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789445870.206009:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 84 00000100:00080000:3.0:1789445870.206035:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445870.212392:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445870.212768:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722092416 00000100:00100000:1.0:1789445870.212777:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722092416 00000100:00100000:1.0:1789445870.212832:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 85 00000100:00100000:1.0:1789445870.212842:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:10508:x1876369722092416:12345-192.168.206.59@tcp:34:lfs.0 00010000:00010000:1.0:1789445870.212909:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d472566bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.212925:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d472566bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.212937:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d472566bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.212952:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472566c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.212959:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472566c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.212966:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472566c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213218:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472566cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213238:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472566cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213245:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472566cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789445870.213295:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472566cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213307:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d472566bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213315:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d472566bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213321:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d472566bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213327:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6f800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445870.213331:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d472566bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213338:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d472566bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213350:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:1.0:1789445870.213353:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445870.213357:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d472566bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213363:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d472566bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213382:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472566c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213389:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472566c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213395:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472566c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213400:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445870.213403:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472566c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213409:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472566c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213416:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe858f5700) 00010000:00010000:1.0:1789445870.213419:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445870.213422:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472566c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213427:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472566c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213635:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472566cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213643:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472566cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213649:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472566cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213661:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445870.213664:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472566cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213669:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472566cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213678:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:1.0:1789445870.213680:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445870.213683:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472566cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.213689:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472566cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445870.213768:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:10508:x1876369722092416:12345-192.168.206.59@tcp:34:lfs.0 Request processed in 925us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445870.213776:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 85 00010000:00010000:2.0:1789445870.299601:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445870.312101:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445870.312299:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722092672 00000100:00100000:0.0:1789445870.312308:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722092672 00000100:00100000:0.0:1789445870.312367:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 86 00000100:00100000:0.0:1789445870.312377:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:10511:x1876369722092672:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:0.0:1789445870.312408:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445870.312427:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472566d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c2c expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.312511:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472566db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.312526:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472566db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.312537:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472566db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.312552:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472566e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.312559:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472566e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.312566:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472566e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.312808:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472566e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.312817:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472566e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.312825:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472566e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445870.312834:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789445870.312925:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472566db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.312933:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472566db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.312940:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472566db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.312947:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445870.312951:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472566db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.312974:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472566db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.312986:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:0.0:1789445870.312989:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445870.312994:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472566db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.313000:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472566db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.313012:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472566e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.313019:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472566e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.313025:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472566e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.313069:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445870.313079:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472566e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.313086:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472566e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.313094:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe98961400) 00010000:00010000:0.0:1789445870.313097:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445870.313100:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472566e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.313107:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472566e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.313146:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472566d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c2c expref: 22 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.313159:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472566e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c2c expref: 21 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.313167:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe98961900) 00010000:00010000:0.0:1789445870.313169:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789445870.313172:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906000, rc 0) 00000100:00100000:0.0:1789445870.313230:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:10511:x1876369722092672:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 854us (1138us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1789445870.313238:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 86 00000100:00100000:3.0:1789445870.319576:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445870.319682:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722092800 00000100:00100000:2.0:1789445870.319692:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722092800 00000100:00100000:2.0:1789445870.319748:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 87 00000100:00100000:2.0:1789445870.319759:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:10511:x1876369722092800:12345-192.168.206.59@tcp:54:lfs.0 00010000:00010000:2.0:1789445870.319823:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d472566f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.319854:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d472566f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.319865:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d472566f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.319891:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d472566f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.319898:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d472566f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.319905:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d472566f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.319911:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445870.319915:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d472566f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.319922:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d472566f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.319933:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe98961900) 00010000:00010000:2.0:1789445870.319936:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789445870.319940:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d472566f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.319946:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d472566f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445870.320017:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:10511:x1876369722092800:12345-192.168.206.59@tcp:54:lfs.0 Request processed in 259us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445870.320030:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 87 00000100:00100000:1.0:1789445870.324624:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445870.324705:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722093056 00000100:00100000:2.0:1789445870.324715:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722093056 00000100:00100000:2.0:1789445870.324768:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 21 00000100:00100000:2.0:1789445870.324778:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c00450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:10511:x1876369722093056:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:2.0:1789445870.324999:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c00450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+22:10511:x1876369722093056:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 221us (382us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1789445870.325007:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 21 00000100:00100000:3.0:1789445870.374678:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445870.374782:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722093312 00000100:00100000:0.0:1789445870.374792:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722093312 00000100:00100000:0.0:1789445870.374849:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 88 00000100:00100000:0.0:1789445870.374859:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+22:10031:x1876369722093312:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:0.0:1789445870.374894:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445870.374916:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472566fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c33 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.375017:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256705 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.375032:0:8204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472566e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c2c expref: 23 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.375041:0:8204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256705 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.375120:0:8204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472566e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c2c expref: 23 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.375133:0:8204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472566e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c2c expref: 23 pid: 8204 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445870.375146:0:8204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8204:1876369742037504:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445870.375229:0:8204:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea485b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789445870.382809:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445870.385196:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722093440 00000100:00100000:2.0:1789445870.385210:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722093440 00010000:00010000:2.0:1789445870.385256:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472566e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c2c expref: 24 pid: 8204 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445870.385316:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 47 00000100:00100000:2.0:1789445870.385326:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:2374:x1876369722093440:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445870.385341:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445870.385348:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472566e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c2c expref: 24 pid: 8204 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.385362:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472566e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c2c expref: 24 pid: 8204 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.385384:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe98961900) 00010000:00010000:2.0:1789445870.385389:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256705 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.385415:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256705 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.385423:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256705 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.385455:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445870.385530:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:2374:x1876369722093440:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 203us (2734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445870.385540:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 47 00010000:00010000:3.0:1789445870.392087:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472566e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c2c expref: 23 pid: 8204 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445870.392121:0:8204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8204:1876369742037504:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789445870.392151:0:8204:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256705 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.392177:0:8204:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256705 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.392184:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256705 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445870.392224:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789445870.392443:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472566fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c33 expref: 24 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.392462:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256705 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c33 expref: 23 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.392472:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe98961900) 00010000:00010000:3.0:1789445870.392476:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789445870.392480:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907200, rc 0) 00000100:00100000:3.0:1789445870.393004:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:10031:x1876369722093312:12345-192.168.206.59@tcp:101:bash.0 Request processed in 18141us (18329us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789445870.393032:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 88 00000100:00100000:0.0:1789445870.401589:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445870.401914:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722093696 00000100:00100000:2.0:1789445870.401929:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722093696 00000100:00100000:2.0:1789445870.402014:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 89 00000100:00100000:2.0:1789445870.402027:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:10031:x1876369722093696:12345-192.168.206.59@tcp:36:bash.0 00010000:00010000:2.0:1789445870.402432:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256713 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.402467:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256713 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.402482:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256713 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789445870.402540:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1789445870.402581:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e309c7a reply state 000000009c38207f transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256713 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445870.402592:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789445870.402700:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1789445870.402836:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+27:10031:x1876369722093696:12345-192.168.206.59@tcp:36:bash.0 Request processed in 809us (1262us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789445870.402852:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 89 00000020:00080000:2.0:1789445870.402858:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789445870.405585:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445870.405717:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722093824 00000100:00100000:0.0:1789445870.405730:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722093824 00000100:00100000:0.0:1789445870.405794:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 90 00000100:00100000:0.0:1789445870.405805:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+27:10031:x1876369722093824:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:0.0:1789445870.405833:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445870.405870:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d4725671a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.405939:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d4725671a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c3a expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.405953:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d4725671a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c3a expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.405972:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe98961900) 00010000:00010000:0.0:1789445870.405975:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789445870.405979:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907e00, rc 0) 00000100:00100000:0.0:1789445870.406039:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+28:10031:x1876369722093824:12345-192.168.206.59@tcp:101:bash.0 Request processed in 236us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445870.406079:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 90 00010000:00010000:3.0:1789445870.407509:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256713 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.407525:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256713 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.407533:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256713 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.407539:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445870.407555:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256713 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.407564:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256713 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.407581:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe98961900) 00010000:00010000:3.0:1789445870.407584:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445870.407589:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256713 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.407596:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256713 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445870.411643:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445870.413726:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722093952 00000100:00100000:3.0:1789445870.413745:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722093952 00000100:00100000:3.0:1789445870.413834:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 33 00000100:00100000:3.0:1789445870.413847:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:10031:x1876369722093952:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:3.0:1789445870.413869:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445870.413909:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256721 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c41 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789445870.413942:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa8c6ea, atime: 0x6aa8c6e8, ctime: 0x6aa8c6ea, blocks: 0xb 00010000:00010000:3.0:1789445870.413969:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=308s v=(0 0) 00010000:00010000:3.0:1789445870.413974:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445870.413983:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256721 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c41 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.414004:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256721 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c41 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.414019:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fce00, rc 0) 00000100:00080000:0.0:1789445870.414192:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789445870.416693:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:10031:x1876369722093952:12345-192.168.206.59@tcp:101:bash.0 Request processed in 2834us (5048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445870.416706:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 33 00000100:00100000:0.0:1789445870.425237:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445870.425508:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722094080 00000100:00100000:1.0:1789445870.425521:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722094080 00002000:00010000:1.0:1789445870.425576:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789445870.425581:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afead8fe680 with x1876369722094080 ext(0->18446744073709551615) 00002000:00010000:1.0:1789445870.425596:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afead8fe680. 00000100:00100000:1.0:1789445870.425642:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 1 00000100:00100000:1.0:1789445870.425653:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2375:x1876369722094080:12345-192.168.206.59@tcp:10:bash.0 00002000:00010000:1.0:1789445870.426005:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789445870.426025:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789445866 -> 1789445870 00002000:00010000:1.0:1789445870.426028:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789445864 -> 1789445864 00002000:00010000:1.0:1789445870.426030:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789445866 -> 1789445870 00002000:00010000:1.0:1789445870.426033:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789445870.426146:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2375:x1876369722094080:12345-192.168.206.59@tcp:10:bash.0 Request processed in 493us (929us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789445870.426154:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 1 00002000:00010000:1.0:1789445870.426158:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789445870.426162:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afead8fe680 with x1876369722094080 ext(0->18446744073709551615) 00002000:00010000:1.0:1789445870.426167:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afead8fe680. 00000100:00100000:1.0:1789445870.548495:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445870.548927:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722094208 00000100:00100000:2.0:1789445870.548940:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722094208 00000100:00100000:2.0:1789445870.549017:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 91 00000100:00100000:2.0:1789445870.549031:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+27:10525:x1876369722094208:12345-192.168.206.59@tcp:34:lfs.0 00010000:00010000:2.0:1789445870.549157:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256728 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.549179:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256728 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.549193:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256728 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.549211:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d4725672f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.549219:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d4725672f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.550114:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d4725672f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.550857:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256736 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.550874:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.550882:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789445870.550947:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.550961:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256728 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.550967:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256728 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.550973:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256728 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.550979:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bee00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445870.550983:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256728 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.550990:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256728 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.551004:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:2.0:1789445870.551007:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445870.551012:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256728 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.551019:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256728 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.551035:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d4725672f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.551041:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d4725672f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.551397:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d4725672f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.551403:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bfc00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445870.551406:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d4725672f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.551413:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d4725672f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.551422:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe90eac400) 00010000:00010000:2.0:1789445870.551425:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445870.551429:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d4725672f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.551445:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d4725672f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.551462:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.551468:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256736 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.551474:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256736 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.551479:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445870.551482:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256736 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.551498:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256736 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.551507:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe98961900) 00010000:00010000:2.0:1789445870.551509:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445870.551513:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256736 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.551519:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256736 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445870.553172:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+27:10525:x1876369722094208:12345-192.168.206.59@tcp:34:lfs.0 Request processed in 4129us (4676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445870.553189:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 91 00000100:00100000:0.0:1789445870.616192:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445870.616440:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722094464 00000100:00100000:3.0:1789445870.616453:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722094464 00000100:00100000:3.0:1789445870.616531:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 92 00000100:00100000:3.0:1789445870.616553:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+27:10528:x1876369722094464:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445870.616583:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445870.616622:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d4725673d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c48 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.616715:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256744 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.616755:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256744 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.616769:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256744 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.616954:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725674b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.616962:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725674b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.616982:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725674b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.624190:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256752 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.626829:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256752 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.626849:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256752 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445870.626872:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789445870.629668:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256744 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.629689:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256744 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.629697:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256744 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.631447:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fda00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445870.631457:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256744 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.633340:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256744 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.633374:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:3.0:1789445870.633377:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445870.633384:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256744 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.633392:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256744 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.633420:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725674b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.633428:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725674b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.633444:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725674b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.633450:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445870.633454:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725674b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.633460:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725674b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.633494:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe8e97a800) 00010000:00010000:3.0:1789445870.633496:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445870.633500:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725674b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.633505:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725674b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.633600:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d4725673d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c48 expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.633630:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256752 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c48 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.633639:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe98961900) 00010000:00010000:3.0:1789445870.633641:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789445870.633644:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fd200, rc 0) 00000100:00100000:3.0:1789445870.637379:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+29:10528:x1876369722094464:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 20821us (21182us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789445870.637396:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 92 00000100:00100000:0.0:1789445870.663485:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445870.673745:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722094592 00000100:00100000:3.0:1789445870.673767:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722094592 00000100:00100000:3.0:1789445870.673867:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 93 00000100:00100000:3.0:1789445870.673881:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+29:10528:x1876369722094592:12345-192.168.206.59@tcp:54:lfs.0 00010000:00010000:3.0:1789445870.673971:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256760 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.673992:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256705 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c33 expref: 29 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.674022:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256760 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.674085:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256705 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c33 expref: 29 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.674102:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256705 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c33 expref: 29 pid: 8204 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445870.674119:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba0f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742037632:192.168.206.59@tcp:104: 00000100:00100000:3.0:1789445870.674492:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8568eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789445870.678118:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba0f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742037632:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789445870.678160:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256760 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445870.680687:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445870.681833:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722094848 00000100:00100000:1.0:1789445870.681849:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722094848 00000100:00100000:1.0:1789445870.681930:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 22 00000100:00100000:1.0:1789445870.681943:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+30:5629:x1876369722094848:12345-192.168.206.59@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789445870.684003:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+31:5629:x1876369722094848:12345-192.168.206.59@tcp:35:ldlm_bl.0 Request processed in 2038us (3305us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789445870.684018:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 22 00000100:00100000:1.0:1789445870.697283:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445870.697465:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722094976 00000100:00100000:3.0:1789445870.697478:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722094976 00010000:00010000:3.0:1789445870.697528:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256705 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c33 expref: 31 pid: 8204 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445870.697585:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 48 00000100:00100000:3.0:1789445870.697598:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+31:2374:x1876369722094976:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445870.697623:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445870.697631:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256705 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c33 expref: 31 pid: 8204 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.697665:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256705 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c33 expref: 31 pid: 8204 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.697690:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256705 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c33 expref: 31 pid: 8204 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.697707:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe98961900) 00010000:00010000:3.0:1789445870.697713:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256760 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.697724:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.697733:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256760 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.697775:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445870.697840:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+30:2374:x1876369722094976:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 244us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445870.697848:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 48 00010000:00010000:0.0:1789445870.698179:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.698190:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.698239:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.698257:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256760 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.698264:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.698270:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445870.698275:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.698283:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256760 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.698293:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe98961900) 00010000:00010000:0.0:1789445870.698296:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789445870.698300:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256760 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.698306:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256760 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445870.698362:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+29:10528:x1876369722094592:12345-192.168.206.59@tcp:54:lfs.0 Request processed in 24484us (34943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445870.698371:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 93 00000100:00100000:1.0:1789445870.707140:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445870.707446:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722095232 00000100:00100000:3.0:1789445870.707463:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722095232 00000100:00100000:3.0:1789445870.707531:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 23 00000100:00100000:3.0:1789445870.707543:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+29:10528:x1876369722095232:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:3.0:1789445870.707862:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+30:10528:x1876369722095232:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 320us (729us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789445870.707870:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 23 00000100:00100000:3.0:1789445870.851998:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445870.852254:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722095488 00000100:00100000:1.0:1789445870.852266:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722095488 00000100:00100000:1.0:1789445870.852341:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 94 00000100:00100000:1.0:1789445870.852354:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+30:10539:x1876369722095488:12345-192.168.206.59@tcp:101:cat.0 00010000:00010000:1.0:1789445870.852385:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445870.852409:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256767 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c4f expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.852530:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d4725676e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.852548:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d4725676e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.852562:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d4725676e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.852579:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256775 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.852587:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.852594:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.852995:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d4725677c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853006:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d4725677c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853150:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d4725677c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445870.853166:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789445870.853281:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d4725676e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853289:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d4725676e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853303:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d4725676e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853309:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6ec00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445870.853313:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d4725676e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853323:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d4725676e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853336:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:1.0:1789445870.853340:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445870.853346:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d4725676e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853353:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d4725676e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853367:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853374:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256775 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853379:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256775 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853384:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6f200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445870.853387:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256775 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853404:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256775 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853412:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe858f5e00) 00010000:00010000:1.0:1789445870.853415:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445870.853419:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256775 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853424:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256775 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853494:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256767 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c4f expref: 33 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853510:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d4725677c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c4f expref: 32 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445870.853519:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe98961900) 00010000:00010000:1.0:1789445870.853521:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789445870.853525:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6ee00, rc 0) 00000100:00100000:1.0:1789445870.853834:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+32:10539:x1876369722095488:12345-192.168.206.59@tcp:101:cat.0 Request processed in 1483us (1850us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789445870.853843:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 94 00000100:00100000:0.0:1789445870.870449:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445870.870567:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722095744 00000100:00100000:1.0:1789445870.870580:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722095744 00000100:00100000:1.0:1789445870.870649:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 24 00000100:00100000:1.0:1789445870.870661:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+32:10539:x1876369722095744:12345-192.168.206.59@tcp:35:cat.0 00000100:00100000:1.0:1789445870.871012:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+33:10539:x1876369722095744:12345-192.168.206.59@tcp:35:cat.0 Request processed in 352us (587us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789445870.871020:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 24 00000100:00100000:3.0:1789445870.906163:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445870.906533:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722096000 00000100:00100000:2.0:1789445870.906546:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722096000 00000100:00100000:2.0:1789445870.906625:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 95 00000100:00100000:2.0:1789445870.906637:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+33:10540:x1876369722096000:12345-192.168.206.59@tcp:36:rm.0 00010000:00010000:2.0:1789445870.906713:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789445870.906904:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d4725677c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c4f expref: 33 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.906930:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256752 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c48 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.906944:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d4725671a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c3a expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.906976:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe98961900) 00010000:00010000:2.0:1789445870.906988:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789445870.907025:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d4725678a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.907095:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d4725678a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.907108:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d4725678a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.907125:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256791 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.907133:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.907140:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.910156:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256798 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.910181:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256798 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.910890:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256798 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789445870.916681:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1789445870.916699:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 308938653042ns, next at 309938648604ns, rc = 0 00010000:00010000:2.0:1789445870.916833:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725679f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.916855:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725679f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.916870:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725679f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.916881:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725679f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.916888:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725679f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.916896:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725679f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.916933:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789445870.916963:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256798 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.916970:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256798 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.916976:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256798 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.916983:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bee00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445870.916989:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256798 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.916997:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256798 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.917028:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe90eac500) 00010000:00010000:2.0:1789445870.917032:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789445870.917038:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256798 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.918164:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445870.918177:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725679f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.918188:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445870.918214:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725679f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.918224:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725679f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.918246:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9afe90eac500) 00010000:00010000:0.0:1789445870.918250:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789445870.918254:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725679f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.918261:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d4725679f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.918280:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445870.918282:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445870.918284:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445870.925470:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256798 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.925543:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d4725678a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.925551:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d4725678a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.925559:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d4725678a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.925565:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445870.925570:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d4725678a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.925579:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d4725678a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.925599:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:2.0:1789445870.925603:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445870.925619:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d4725678a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445870.925626:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d4725678a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789445870.925666:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030acdf41 reply state 0000000024142d83 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445870.925676:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789445870.925836:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+32:10540:x1876369722096000:12345-192.168.206.59@tcp:36:rm.0 Request processed in 19196us (19682us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789445870.925847:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 95 00010000:00010000:3.0:1789445870.929488:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.929511:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256791 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.929520:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256791 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.929527:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bfc00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445870.929533:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256791 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.929542:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256791 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.929563:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe90eac400) 00010000:00010000:3.0:1789445870.929566:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445870.929572:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256791 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445870.929579:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256791 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445870.997288:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445870.997847:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722096256 00000100:00100000:0.0:1789445870.997868:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722096256 00000100:00100000:0.0:1789445870.997937:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 96 00000100:00100000:0.0:1789445870.997948:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+31:10546:x1876369722096256:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:0.0:1789445870.997979:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445870.998004:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d472567a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c56 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.998182:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472567ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.998201:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472567ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.998217:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472567ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.998263:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d472567b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.998272:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d472567b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445870.998280:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d472567b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789445871.000221:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1789445871.002095:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472567bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.002124:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472567bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.002139:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472567bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.002187:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472567ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.002196:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472567ad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.002204:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472567ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.002210:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445871.002215:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472567ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.002246:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472567ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.002261:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:0.0:1789445871.002264:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445871.002271:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472567ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.002277:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472567ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789445871.002293:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000328f9467 reply state 00000000722ba9a5 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d472567b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445871.002303:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789445871.002349:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d472567a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c56 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.002367:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472567bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c56 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.002374:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe98961200) 00010000:00010000:0.0:1789445871.002377:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789445871.002379:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907e00, rc 0) 00000100:00100000:0.0:1789445871.002479:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+34:10546:x1876369722096256:12345-192.168.206.59@tcp:101:bash.0 Request processed in 4531us (5202us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789445871.002490:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 96 00010000:00010000:3.0:1789445871.007937:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d472567b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.007957:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d472567b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.007986:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d472567b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.007993:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445871.007998:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d472567b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.008006:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d472567b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.008025:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe98961400) 00010000:00010000:3.0:1789445871.008028:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445871.008034:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d472567b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.008041:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d472567b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445871.008655:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445871.008726:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722096384 00000100:00100000:2.0:1789445871.008738:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722096384 00000100:00100000:2.0:1789445871.008812:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 34 00000100:00100000:2.0:1789445871.008822:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2375:x1876369722096384:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:2.0:1789445871.008842:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445871.008871:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119e82b0/0xc1b37c4d472567c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c5d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789445871.008901:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445871.008924:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=309s v=(0 0) 00010000:00010000:2.0:1789445871.008929:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445871.008939:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119e82b0/0xc1b37c4d472567c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c5d expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.008958:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000119e82b0/0xc1b37c4d472567c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c5d expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.008971:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57be200, rc 0) 00000100:00100000:2.0:1789445871.009024:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2375:x1876369722096384:12345-192.168.206.59@tcp:101:bash.0 Request processed in 204us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445871.009040:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 34 00000100:00080000:0.0:1789445871.009313:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789445871.013787:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445871.013884:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722096512 00000100:00100000:2.0:1789445871.013896:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722096512 00000100:00100000:2.0:1789445871.013956:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 35 00000100:00100000:2.0:1789445871.013967:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:10546:x1876369722096512:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:2.0:1789445871.013989:0:11692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445871.014011:0:11692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074a5aca9/0xc1b37c4d472567d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c64 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.014083:0:11692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000119e82b0/0xc1b37c4d472567c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c5d expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.014095:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445871.014100:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445871.014105:0:11692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074a5aca9/0xc1b37c4d472567d0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c64 expref: 7 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.014148:0:11692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000119e82b0/0xc1b37c4d472567c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c5d expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.014163:0:11692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000119e82b0/0xc1b37c4d472567c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c5d expref: 7 pid: 6685 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445871.014180:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffa4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11692:1876369742037760:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445871.014285:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789445871.024354:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445871.024489:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffa4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11692:1876369742037760:192.168.206.59@tcp:104: 00010000:00010000:2.0:1789445871.024537:0:11692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000074a5aca9/0xc1b37c4d472567d0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c64 expref: 7 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.024562:0:11692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bee00, rc 0) 00000100:00100000:2.0:1789445871.024648:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:10546:x1876369722096512:12345-192.168.206.59@tcp:101:bash.0 Request processed in 10683us (10874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445871.024658:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 35 00000100:00100000:3.0:1789445871.024868:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722096640 00000100:00100000:3.0:1789445871.024877:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722096640 00010000:00010000:3.0:1789445871.024919:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000119e82b0/0xc1b37c4d472567c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c5d expref: 7 pid: 6685 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445871.024961:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 49 00000100:00100000:3.0:1789445871.024971:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe919b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2374:x1876369722096640:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445871.024988:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445871.025017:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000119e82b0/0xc1b37c4d472567c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c5d expref: 7 pid: 6685 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.025072:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000119e82b0/0xc1b37c4d472567c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c5d expref: 7 pid: 6685 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.025103:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119e82b0/0xc1b37c4d472567c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c5d expref: 7 pid: 6685 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.025120:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445871.025125:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445871.025134:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074a5aca9/0xc1b37c4d472567d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c64 expref: 6 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.025146:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074a5aca9/0xc1b37c4d472567d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c64 expref: 6 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.025186:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000074a5aca9/0xc1b37c4d472567d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c64 expref: 6 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445871.025202:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba628e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1876369742037888:192.168.206.59@tcp:105: 00000100:00100000:3.0:1789445871.025262:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8568e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445871.034566:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba628e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1876369742037888:192.168.206.59@tcp:105: 00010000:00010000:1.0:1789445871.034632:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445871.034711:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe919b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2374:x1876369722096640:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 9740us (10369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445871.035770:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 49 00000100:00100000:1.0:1789445871.052189:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445871.052462:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722096896 00000100:00100000:2.0:1789445871.052476:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722096896 00000100:00100000:2.0:1789445871.052550:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 25 00000100:00100000:2.0:1789445871.052562:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+33:10546:x1876369722096896:12345-192.168.206.59@tcp:35:bash.0 00000100:00100000:2.0:1789445871.053444:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+34:10546:x1876369722096896:12345-192.168.206.59@tcp:35:bash.0 Request processed in 869us (1255us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789445871.053455:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 25 00000100:00100000:3.0:1789445871.270305:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445871.270479:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722097024 00000100:00100000:0.0:1789445871.270489:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722097024 00000100:00100000:0.0:1789445871.270549:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 97 00000100:00100000:0.0:1789445871.270559:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+34:10562:x1876369722097024:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:0.0:1789445871.270582:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445871.270601:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d472567d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c6b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.270669:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472567de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.270682:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472567de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.270693:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472567de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445871.270727:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789445871.270730:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789445871.270748:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472567de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.270781:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d472567d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c6b expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.270799:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472567de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c6b expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.270808:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:0.0:1789445871.270811:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789445871.270828:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907600, rc 0) 00000100:00100000:0.0:1789445871.270891:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+35:10562:x1876369722097024:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 334us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445871.270898:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 97 00000100:00100000:3.0:1789445871.278524:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445871.278760:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722097280 00000100:00100000:1.0:1789445871.278780:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722097280 00000100:00100000:1.0:1789445871.278834:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 98 00000100:00100000:1.0:1789445871.278843:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+35:10562:x1876369722097280:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:1.0:1789445871.278862:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445871.278880:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d472567e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c72 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.278969:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d472567ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.278982:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d472567ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.278993:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d472567ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445871.279004:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789445871.279180:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d472567e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c72 expref: 38 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.279198:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d472567ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c72 expref: 37 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.279206:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe98961200) 00010000:00010000:1.0:1789445871.279208:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789445871.279212:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6f200, rc 0) 00000100:00100000:1.0:1789445871.279525:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+37:10562:x1876369722097280:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 682us (1008us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789445871.279534:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 98 00000100:00100000:1.0:1789445871.286659:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445871.286703:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445871.286806:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722097664 00000100:00100000:0.0:1789445871.286815:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722097664 00000100:00100000:0.0:1789445871.286871:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 99 00000100:00100000:0.0:1789445871.286881:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+37:10562:x1876369722097664:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:0.0:1789445871.286903:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445871.286923:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d472567fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c79 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.287009:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256801 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.287024:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256801 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.287035:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256801 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445871.287072:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789445871.287183:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d472567fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c79 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.287202:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256801 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c79 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.287210:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe98961200) 00010000:00010000:0.0:1789445871.287225:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789445871.287230:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906800, rc 0) 00000100:00100000:0.0:1789445871.287303:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+39:10562:x1876369722097664:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 424us (599us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789445871.287311:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 99 00000100:00100000:3.0:1789445871.288114:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722097408 00000100:00100000:3.0:1789445871.288122:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722097408 00000100:00100000:3.0:1789445871.288168:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00100000:3.0:1789445871.288177:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+39:2375:x1876369722097408:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445871.288198:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445871.288216:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d472567ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c72 expref: 39 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.288232:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe98961200) 00010000:00010000:3.0:1789445871.288236:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445871.288286:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+38:2375:x1876369722097408:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 110us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445871.288293:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00100000:3.0:1789445871.294446:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445871.294514:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722097792 00000100:00100000:2.0:1789445871.294525:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722097792 00000100:00100000:2.0:1789445871.294577:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 36 00000100:00100000:2.0:1789445871.294587:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2374:x1876369722097792:12345-192.168.206.59@tcp:1:lfs.0 00010000:00010000:2.0:1789445871.294626:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d4725680f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.294645:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000074a5aca9/0xc1b37c4d472567d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c64 expref: 6 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.294654:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445871.294669:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789445871.294674:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d4725680f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.294707:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000074a5aca9/0xc1b37c4d472567d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c64 expref: 6 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.294721:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000074a5aca9/0xc1b37c4d472567d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c64 expref: 6 pid: 11692 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445871.294736:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffa4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1876369742038016:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445871.294829:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d2600 going to sleep for 11 seconds 00000100:00100000:1.0:1789445871.297120:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffa4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1876369742038016:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789445871.297148:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d4725680f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445871.305138:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445871.305235:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722097920 00000100:00100000:0.0:1789445871.305250:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722097920 00002000:00100000:0.0:1789445871.305297:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9afebffc3100 x1876369722097920/t0(0) o4->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:752/0 lens 504/0 e 0 to 0 dl 1789445882 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789445871.305308:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afebffc3100 with x1876369722097920 ext(0->8) 00010000:00010000:0.0:1789445871.305318:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000074a5aca9/0xc1b37c4d472567d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c64 expref: 7 pid: 11692 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.305335:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000074a5aca9/0xc1b37c4d472567d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c64 expref: 7 pid: 11692 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789445871.305342:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9afebffc3100 00000100:00100000:0.0:1789445871.305378:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 1 00000100:00100000:0.0:1789445871.305388:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2375:x1876369722097920:12345-192.168.206.59@tcp:4:lfs.0 00000100:00100000:0.0:1789445871.305989:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:2375:x1876369722097920:12345-192.168.206.59@tcp:4:lfs.0 Request processed in 600us (857us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789445871.305998:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 1 00002000:00100000:0.0:1789445871.306006:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9afebffc3100 x1876369722097920/t4294967302(0) o4->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:752/0 lens 504/448 e 0 to 0 dl 1789445882 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789445871.306014:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afebffc3100 with x1876369722097920 ext(0->8) 00010000:00010000:0.0:1789445871.306026:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000074a5aca9/0xc1b37c4d472567d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c64 expref: 9 pid: 11692 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.306039:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000074a5aca9/0xc1b37c4d472567d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c64 expref: 9 pid: 11692 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789445871.306082:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9afebffc3100 00000100:00100000:0.0:1789445871.311817:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445871.312011:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722098048 00000100:00100000:2.0:1789445871.312021:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722098048 00010000:00010000:2.0:1789445871.312082:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074a5aca9/0xc1b37c4d472567d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c64 expref: 9 pid: 11692 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445871.312125:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 50 00000100:00100000:2.0:1789445871.312135:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:2374:x1876369722098048:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445871.312148:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789445871.312167:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789445871.312170:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789445870 00002000:00010000:2.0:1789445871.312173:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789445871 00002000:00010000:2.0:1789445871.312175:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789445870 00010000:00010000:2.0:1789445871.312182:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074a5aca9/0xc1b37c4d472567d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c64 expref: 9 pid: 11692 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.312215:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074a5aca9/0xc1b37c4d472567d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c64 expref: 9 pid: 11692 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.312248:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074a5aca9/0xc1b37c4d472567d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c64 expref: 9 pid: 11692 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.312265:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789445871.312269:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789445871.312555:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d4725680f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.312568:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d4725680f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.312601:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445871.312655:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2374:x1876369722098048:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 521us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445871.312663:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 50 00010000:00010000:1.0:1789445871.312732:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d4725680f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.312743:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d4725680f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.312778:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d4725680f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.312800:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d4725680f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.312808:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d4725680f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.312816:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf000 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445871.312820:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d4725680f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.312830:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d4725680f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.312843:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d4725680f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.312851:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d4725680f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445871.312897:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2374:x1876369722097792:12345-192.168.206.59@tcp:1:lfs.0 Request processed in 18312us (18472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445871.312904:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 36 00000100:00100000:2.0:1789445871.315852:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445871.315976:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722098304 00000100:00100000:3.0:1789445871.315985:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722098304 00000100:00100000:3.0:1789445871.316037:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 26 00000100:00100000:3.0:1789445871.316085:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c02450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+38:10562:x1876369722098304:12345-192.168.206.59@tcp:35:lfs.0 00000004:00010000:3.0:1789445871.316143:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256801 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c79 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789445871.316738:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1789445871.316928:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1789445871.321180:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1789445871.321338:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256816 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.321358:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472567bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c56 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.321384:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256816 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.321713:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472567bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c56 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.321730:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472567bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c56 expref: 42 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445871.321745:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffa5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1876369742038144:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445871.321961:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d2c00 going to sleep for 11 seconds 00010000:00010000:1.0:1789445871.322190:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445871.326698:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445871.326800:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffa5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1876369742038144:192.168.206.59@tcp:104: 00010000:00010000:2.0:1789445871.326827:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256816 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445871.326990:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722098432 00000100:00100000:3.0:1789445871.326997:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722098432 00010000:00010000:3.0:1789445871.327033:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472567bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c56 expref: 43 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445871.327106:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 51 00000100:00100000:3.0:1789445871.327116:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+43:2374:x1876369722098432:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445871.327143:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445871.327150:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472567bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c56 expref: 43 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.327162:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472567bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c56 expref: 43 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.327183:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d472567bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c56 expref: 43 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.327197:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe98961200) 00010000:00010000:3.0:1789445871.327202:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256816 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.327211:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256816 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.327218:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256816 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.327249:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789445871.327454:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256816 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.327462:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256816 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789445871.327584:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1789445871.327763:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1789445871.327875:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffa5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876369742038272:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789445871.327914:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445871.327939:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445871.328175:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742038272 00000100:00100000:0.0:1789445871.328181:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742038272 00000100:00100000:0.0:1789445871.328233:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789445871.328250:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1876369742038272:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789445871.328324:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1876369742038272:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445871.328330:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789445871.328580:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445871.328662:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+44:2374:x1876369722098432:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 1545us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445871.328670:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 51 00000100:00100000:2.0:1789445871.328749:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1789445871.328764:0:5843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1789445871.328792:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afead8fdc00, transno 4294967301 00000100:00100000:2.0:1789445871.328812:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffa5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876369742038272:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789445871.329274:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1789445871.329988:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffa5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876369742038400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789445871.330036:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445871.330140:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789445871.332809:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742038400 00000100:00100000:1.0:1789445871.332835:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742038400 00000100:00100000:1.0:1789445871.332894:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789445871.332904:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1876369742038400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789445871.333363:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1876369742038400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 459us (3324us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789445871.333371:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789445871.333588:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffa5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876369742038400:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789445871.333658:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1789445871.333706:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256816 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.333717:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256816 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.333724:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256816 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.333730:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445871.333735:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256816 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.333743:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256816 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.333757:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe98961200) 00010000:00010000:2.0:1789445871.333760:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789445871.333765:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256816 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.333793:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256816 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789445871.333974:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789445871.334098:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1789445871.334109:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 309356063589ns, next at 310356061095ns, rc = 0 00000001:00080000:2.0:1789445871.334116:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1789445871.334149:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe98961200) 00010000:00010000:2.0:1789445871.334153:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789445871.334160:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256801 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c79 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445871.334253:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c02450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+45:10562:x1876369722098304:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 18207us (18410us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1789445871.334262:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 26 00000020:00080000:2.0:1789445871.334265:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789445871.337661:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445871.337795:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722098560 00000100:00100000:2.0:1789445871.337804:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722098560 00000100:00100000:2.0:1789445871.337861:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 100 00000100:00100000:2.0:1789445871.337872:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+45:10562:x1876369722098560:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:2.0:1789445871.337894:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445871.337914:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d4725681d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c80 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.337971:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d4725681d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c80 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.338005:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d4725681d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c80 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.338025:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:2.0:1789445871.338029:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789445871.338032:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bee00, rc 0) 00000100:00100000:2.0:1789445871.338107:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+46:10562:x1876369722098560:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 237us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445871.338115:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 100 00000100:00100000:3.0:1789445871.343345:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445871.343455:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722098816 00000100:00100000:2.0:1789445871.343463:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722098816 00000100:00100000:2.0:1789445871.343528:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 27 00000100:00100000:2.0:1789445871.343539:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+46:10562:x1876369722098816:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:2.0:1789445871.343760:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+47:10562:x1876369722098816:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 222us (422us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1789445871.343767:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 27 00000100:00100000:0.0:1789445871.495510:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445871.495619:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722098944 00000100:00100000:3.0:1789445871.495644:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722098944 00000100:00100000:3.0:1789445871.495729:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 101 00000100:00100000:3.0:1789445871.495758:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+47:10572:x1876369722098944:12345-192.168.206.59@tcp:34:lfs.0 00010000:00010000:3.0:1789445871.495859:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256824 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.495881:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256824 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.495895:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256824 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.495913:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725682b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.495921:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725682b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.495928:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725682b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496041:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256832 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496093:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496100:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789445871.496155:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496171:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256824 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496185:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256824 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496193:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256824 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496200:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fda00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445871.496206:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256824 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496215:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256824 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496229:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:3.0:1789445871.496233:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445871.496238:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256824 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496245:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d47256824 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496262:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725682b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496269:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725682b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496274:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725682b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496279:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445871.496288:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725682b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496294:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725682b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496303:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe8e97a100) 00010000:00010000:3.0:1789445871.496306:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445871.496309:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725682b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496315:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d4725682b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496332:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496338:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256832 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496343:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496348:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fd200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445871.496351:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496357:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256832 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496364:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:3.0:1789445871.496366:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445871.496375:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256832 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.496381:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256832 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445871.496478:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+47:10572:x1876369722098944:12345-192.168.206.59@tcp:34:lfs.0 Request processed in 722us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445871.496486:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 101 00000100:00100000:3.0:1789445871.555184:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445871.556273:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722099200 00000100:00100000:2.0:1789445871.556290:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722099200 00000100:00100000:2.0:1789445871.556376:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 102 00000100:00100000:2.0:1789445871.556388:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+47:10575:x1876369722099200:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:2.0:1789445871.556417:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445871.556455:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256839 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.556563:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256840 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.556594:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256840 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.556609:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256840 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.556630:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256847 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.556637:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.556644:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.557588:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725684e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.557604:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725684e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.557615:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725684e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445871.557628:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789445871.557973:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256840 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.557982:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256840 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.557989:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256840 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.558324:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445871.558330:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256840 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.558340:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256840 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.558356:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:2.0:1789445871.558360:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445871.558367:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256840 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.558373:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256840 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.558391:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.558397:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256847 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.558402:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.558408:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445871.558410:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.558416:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256847 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.558449:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe90eacd00) 00010000:00010000:2.0:1789445871.558451:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445871.558455:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256847 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.558472:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256847 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.558536:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256839 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c87 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.558553:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725684e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c87 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.558560:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:2.0:1789445871.558562:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789445871.558565:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf600, rc 0) 00000100:00100000:2.0:1789445871.558658:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+49:10575:x1876369722099200:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 2271us (3484us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789445871.558669:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 102 00000100:00100000:0.0:1789445871.566774:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445871.566914:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722099328 00000100:00100000:3.0:1789445871.566926:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722099328 00000100:00100000:3.0:1789445871.566999:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 103 00000100:00100000:3.0:1789445871.567020:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+49:10575:x1876369722099328:12345-192.168.206.59@tcp:54:lfs.0 00010000:00010000:3.0:1789445871.567147:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725685c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.567168:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725685c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.567184:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725685c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.567224:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725685c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.567232:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725685c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.567481:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725685c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.567508:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fd200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445871.567513:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725685c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.567521:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725685c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.567534:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:3.0:1789445871.567537:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789445871.567543:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725685c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.567550:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725685c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445871.567633:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+49:10575:x1876369722099328:12345-192.168.206.59@tcp:54:lfs.0 Request processed in 623us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445871.567642:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 103 00000100:00100000:0.0:1789445871.576530:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445871.576645:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722099584 00000100:00100000:2.0:1789445871.576657:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722099584 00000100:00100000:2.0:1789445871.576734:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 28 00000100:00100000:2.0:1789445871.576747:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+49:10575:x1876369722099584:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:2.0:1789445871.577116:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+50:10575:x1876369722099584:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 370us (599us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789445871.577125:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 28 00000100:00100000:0.0:1789445871.656237:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445871.656484:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722099840 00000100:00100000:2.0:1789445871.656497:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722099840 00000100:00100000:2.0:1789445871.656566:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 104 00000100:00100000:2.0:1789445871.656577:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+50:10585:x1876369722099840:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:2.0:1789445871.656607:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445871.656612:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789445871.656642:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472567de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c6b expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.656664:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:2.0:1789445871.656670:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789445871.656686:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256863 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c8e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.656799:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d4725686a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.656814:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725684e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c87 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.656822:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d4725686a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.656860:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725684e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c87 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.656875:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725684e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c87 expref: 50 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445871.656912:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffa4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742038528:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445871.657033:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789445871.663524:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffa4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742038528:192.168.206.59@tcp:104: 00010000:00010000:2.0:1789445871.663575:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d4725686a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445871.671586:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445871.671756:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722099968 00000100:00100000:1.0:1789445871.671770:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722099968 00010000:00010000:1.0:1789445871.671842:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725684e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c87 expref: 51 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445871.671911:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 52 00000100:00100000:1.0:1789445871.671923:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+51:2375:x1876369722099968:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789445871.671942:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445871.671951:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725684e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c87 expref: 51 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.671968:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725684e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c87 expref: 51 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.671993:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725684e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c87 expref: 51 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.672031:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:1.0:1789445871.672038:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d4725686a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.672099:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d4725686a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.672125:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d4725686a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.672168:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789445871.672592:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d4725686a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.672603:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d4725686a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445871.672645:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789445871.672849:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256863 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c8e expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.672867:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d4725686a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c8e expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.672888:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:3.0:1789445871.672892:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789445871.672894:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf000, rc 0) 00000100:00100000:3.0:1789445871.672951:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+51:10585:x1876369722099840:12345-192.168.206.59@tcp:101:bash.0 Request processed in 16375us (16732us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789445871.672959:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 104 00000100:00100000:1.0:1789445871.674880:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+50:2375:x1876369722099968:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 2944us (3308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445871.674896:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 52 00000100:00100000:3.0:1789445871.676957:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445871.677109:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722100224 00000100:00100000:2.0:1789445871.677122:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722100224 00000100:00100000:2.0:1789445871.677192:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 105 00000100:00100000:2.0:1789445871.677222:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+50:10585:x1876369722100224:12345-192.168.206.59@tcp:36:bash.0 00010000:00010000:2.0:1789445871.677644:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256878 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.677665:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256878 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.677679:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256878 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789445871.677752:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1789445871.677776:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000fff6d0e reply state 00000000461e3d8c transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256878 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445871.677785:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789445871.683087:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+53:10585:x1876369722100224:12345-192.168.206.59@tcp:36:bash.0 Request processed in 5851us (6125us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789445871.683106:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 105 00000020:00080000:2.0:1789445871.683148:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789445871.691190:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256878 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.691841:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256878 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.691853:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256878 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.691882:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445871.691889:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256878 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.691899:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256878 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.691921:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:0.0:1789445871.691924:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445871.691930:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256878 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.691938:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256878 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445871.692475:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445871.692668:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722100352 00000100:00100000:2.0:1789445871.692681:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722100352 00000100:00100000:2.0:1789445871.692840:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 106 00000100:00100000:2.0:1789445871.692853:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+52:10585:x1876369722100352:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:2.0:1789445871.692881:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445871.692904:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d4725687f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c95 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.693474:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256886 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.693494:0:8204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d4725686a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c8e expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.693504:0:8204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256886 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.693608:0:8204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d4725686a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c8e expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.693624:0:8204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d4725686a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c8e expref: 53 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445871.693641:0:8204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffa4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8204:1876369742038656:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445871.693743:0:8204:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d2180 going to sleep for 11 seconds 00000100:00100000:0.0:1789445871.699737:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445871.700243:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722100480 00000100:00100000:1.0:1789445871.700256:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722100480 00010000:00010000:1.0:1789445871.700308:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d4725686a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c8e expref: 54 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445871.700386:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 53 00000100:00100000:1.0:1789445871.700397:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+54:2374:x1876369722100480:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789445871.700424:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445871.700439:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d4725686a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c8e expref: 54 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.700456:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d4725686a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c8e expref: 54 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.700483:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:1.0:1789445871.700488:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256886 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.700499:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.700530:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256886 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.700565:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445871.700643:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+54:2374:x1876369722100480:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 247us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445871.700651:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 53 00010000:00010000:2.0:1789445871.702378:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d4725686a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c8e expref: 53 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445871.702443:0:8204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffa4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8204:1876369742038656:192.168.206.59@tcp:104: 00010000:00010000:2.0:1789445871.702474:0:8204:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.702485:0:8204:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.702492:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445871.702684:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789445871.702690:0:8204:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789445871.702717:0:8204:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.702759:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d4725687f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c95 expref: 53 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.702840:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c95 expref: 52 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.702848:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:2.0:1789445871.702852:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789445871.702855:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57be400, rc 0) 00000100:00100000:2.0:1789445871.702991:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+52:10585:x1876369722100352:12345-192.168.206.59@tcp:101:bash.0 Request processed in 10139us (10520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445871.703001:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 106 00000100:00100000:2.0:1789445871.708996:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789445871.709034:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742038784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789445871.709131:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445871.709354:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742038784 00000100:00100000:1.0:1789445871.709364:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742038784 00000100:00100000:1.0:1789445871.709420:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789445871.709442:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876369742038784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789445871.709470:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445871.709532:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876369742038784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445871.709549:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789445871.709687:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742038784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789445871.710549:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445871.710672:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722100736 00000100:00100000:2.0:1789445871.710679:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722100736 00000100:00100000:2.0:1789445871.710729:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 29 00000100:00100000:2.0:1789445871.710739:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+52:10585:x1876369722100736:12345-192.168.206.59@tcp:35:bash.0 00000100:00100000:2.0:1789445871.711039:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+53:10585:x1876369722100736:12345-192.168.206.59@tcp:35:bash.0 Request processed in 302us (505us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789445871.711080:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 29 00000100:00100000:0.0:1789445871.793346:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445871.793609:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722100864 00000100:00100000:1.0:1789445871.793622:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722100864 00000100:00100000:1.0:1789445871.793699:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 107 00000100:00100000:1.0:1789445871.793711:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+53:10591:x1876369722100864:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:1.0:1789445871.793742:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445871.793780:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d4725688d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4c9c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.793858:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256894 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.793895:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.793908:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445871.793949:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789445871.793952:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789445871.793973:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.794001:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d4725688d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c9c expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.794035:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256894 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c9c expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.794406:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:1.0:1789445871.794410:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789445871.794574:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6fe00, rc 0) 00000100:00100000:1.0:1789445871.794657:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+54:10591:x1876369722100864:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 947us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445871.794665:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 107 00000100:00100000:1.0:1789445871.798330:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445871.798638:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722100992 00000100:00100000:3.0:1789445871.798652:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722100992 00000100:00100000:3.0:1789445871.798719:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 108 00000100:00100000:3.0:1789445871.798732:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+54:10591:x1876369722100992:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445871.798758:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445871.798907:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725689b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ca3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.798988:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d472568a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.799006:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d472568a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.799819:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d472568a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800001:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472568a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800024:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472568a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800033:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472568a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800402:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472568b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800426:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472568b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800467:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472568b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445871.800516:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789445871.800521:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789445871.800545:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472568b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800559:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472568b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800569:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d472568a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800576:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d472568a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800583:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d472568a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800591:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445871.800596:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d472568a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800605:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d472568a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800618:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:0.0:1789445871.800622:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445871.800628:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d472568a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800645:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc600/0xc1b37c4d472568a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800660:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472568a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800667:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472568a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800673:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472568a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800678:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445871.800680:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472568a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800686:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472568a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800694:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe98961e00) 00010000:00010000:0.0:1789445871.800697:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445871.800700:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472568a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800706:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d472568a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800752:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725689b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ca3 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800770:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472568b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ca3 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445871.800785:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:0.0:1789445871.800787:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789445871.800790:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906000, rc 0) 00000100:00100000:0.0:1789445871.800886:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:10591:x1876369722100992:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 2154us (2567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445871.800897:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 108 00000100:00100000:2.0:1789445871.805899:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445871.806439:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722101248 00000100:00100000:1.0:1789445871.806452:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722101248 00000100:00100000:1.0:1789445871.806580:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 109 00000100:00100000:1.0:1789445871.806593:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:10591:x1876369722101248:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:1.0:1789445871.806638:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445871.806668:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d472568b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4caa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.806821:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.806839:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256886 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c95 expref: 56 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.806848:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472568b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ca3 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.806857:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.806900:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472568b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ca3 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.806916:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472568b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ca3 expref: 56 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445871.806932:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb29880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742038912:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789445871.807116:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c95 expref: 56 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.807127:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256886 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c95 expref: 56 pid: 8204 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445871.807150:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742039040:192.168.206.59@tcp:104: 00000100:00100000:1.0:1789445871.807179:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87ddef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789445871.811960:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445871.812585:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb29880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742038912:192.168.206.59@tcp:104: 00000100:00100000:3.0:1789445871.812692:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722101376 00000100:00100000:3.0:1789445871.812703:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722101376 00010000:00010000:3.0:1789445871.812837:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472568b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ca3 expref: 57 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445871.812887:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 54 00000100:00100000:3.0:1789445871.812899:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+57:2375:x1876369722101376:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445871.812920:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445871.812928:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472568b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ca3 expref: 57 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.812942:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472568b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ca3 expref: 57 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.812967:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d472568b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ca3 expref: 57 pid: 5840 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.812985:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:3.0:1789445871.812991:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.813001:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.813843:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445871.813927:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+56:2375:x1876369722101376:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 1026us (1978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445871.813937:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 54 00000100:00100000:1.0:1789445871.816469:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742039040:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789445871.816517:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445871.818632:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445871.818775:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722101504 00000100:00100000:3.0:1789445871.818785:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722101504 00010000:00010000:3.0:1789445871.818848:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256886 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c95 expref: 56 pid: 8204 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445871.818895:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 55 00000100:00100000:3.0:1789445871.818906:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe919b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+56:2375:x1876369722101504:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445871.818924:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445871.818933:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256886 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c95 expref: 56 pid: 8204 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.818947:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c95 expref: 56 pid: 8204 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.818975:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256886 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c95 expref: 56 pid: 8204 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.818994:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:3.0:1789445871.818999:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.819407:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.819441:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.819476:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445871.819553:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe919b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:2375:x1876369722101504:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 647us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445871.819562:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 55 00010000:00010000:1.0:1789445871.820585:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.820599:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445871.820626:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789445871.820844:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d472568b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4caa expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.820870:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4caa expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445871.820879:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:1.0:1789445871.820882:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789445871.820886:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6e200, rc 0) 00000100:00100000:1.0:1789445871.820951:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:10591:x1876369722101248:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 14361us (15065us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789445871.820976:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 109 00000100:00100000:1.0:1789445871.828159:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445871.829700:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722101760 00000100:00100000:3.0:1789445871.829717:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722101760 00000100:00100000:3.0:1789445871.829821:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:3.0:1789445871.829834:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:10591:x1876369722101760:12345-192.168.206.59@tcp:103:lfs.0 00010000:00010000:3.0:1789445871.829855:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445871.829890:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d4725681d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c80 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.829915:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:3.0:1789445871.829921:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445871.830005:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+54:10591:x1876369722101760:12345-192.168.206.59@tcp:103:lfs.0 Request processed in 173us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445871.830019:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:2.0:1789445871.833370:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445871.833983:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722101888 00000100:00100000:3.0:1789445871.833996:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722101888 00000100:00100000:2.0:1789445871.834569:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 110 00000100:00100000:2.0:1789445871.834581:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+54:10591:x1876369722101888:12345-192.168.206.59@tcp:58:lfs.0 00010000:00010000:2.0:1789445871.834735:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472568cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.834756:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472568cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445871.834783:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472568cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789445871.835359:0:8204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789445871.835485:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+54:10591:x1876369722101888:12345-192.168.206.59@tcp:58:lfs.0 Request processed in 904us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445871.835503:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 110 00000100:00100000:0.0:1789445871.838371:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445871.838496:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722102016 00000100:00100000:3.0:1789445871.838507:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722102016 00000100:00100000:3.0:1789445871.838605:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 111 00000100:00100000:3.0:1789445871.838615:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+54:10591:x1876369722102016:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445871.838642:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445871.838667:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d472568d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4cb1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.838736:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472568cc lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.838748:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d472568d3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cb1 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.838802:0:5841:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472568cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.838820:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d472568d3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cb1 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.838837:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:3.0:1789445871.838841:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789445871.838845:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d472568d3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cb1 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445871.838854:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fda00, rc 0) 00000100:00100000:3.0:1789445871.838922:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:10591:x1876369722102016:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 309us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445871.838929:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 111 00000100:00100000:1.0:1789445872.164249:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445872.165260:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445872.165299:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445872.165348:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445872.165465:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722102272 00000100:00100000:0.0:1789445872.165479:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722102272 00000100:00100000:0.0:1789445872.165552:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722102400 00000100:00100000:0.0:1789445872.165555:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722102400 00000100:00100000:0.0:1789445872.165600:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 72 00000100:00100000:0.0:1789445872.165613:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2377:x1876369722102272:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445872.165709:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2377:x1876369722102272:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 98us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445872.165717:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 72 00000100:00100000:0.0:1789445872.165739:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 73 00000100:00100000:0.0:1789445872.165746:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2376:x1876369722102400:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445872.165786:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2376:x1876369722102400:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 26us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445872.165793:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 73 00000100:00100000:0.0:1789445872.165939:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722102528 00000100:00100000:0.0:1789445872.165943:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722102528 00000100:00100000:0.0:1789445872.165981:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 129 00000100:00100000:0.0:1789445872.165999:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2377:x1876369722102528:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445872.166105:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2377:x1876369722102528:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 117us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445872.166112:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 129 00000100:00080000:1.0:1789445872.166493:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789445872.166500:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789445872.180374:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722102144 00000100:00100000:3.0:1789445872.180393:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722102144 00000100:00100000:3.0:1789445872.180757:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 285 00000100:00100000:3.0:1789445872.181154:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2376:x1876369722102144:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445872.181390:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2376:x1876369722102144:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 622us (17152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445872.181399:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 285 00010000:00010000:2.0:1789445872.346300:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789445872.544731:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789445872.544744:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789445872.544835:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789445872.544842:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789445872.545104:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1876369742039168:192.168.206.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789445872.545238:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8568ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789445872.549978:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445872.550145:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722102656 00000100:00100000:2.0:1789445872.550154:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722102656 00000100:00100000:2.0:1789445872.550238:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 112 00000100:00100000:2.0:1789445872.550250:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+56:10593:x1876369722102656:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789445872.550278:0:8204:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789445872.550376:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+56:10593:x1876369722102656:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 Request processed in 128us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445872.550383:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 112 00000100:00080000:1.0:1789445872.550590:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445872.552446:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1876369742039168:192.168.206.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789445872.553087:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445872.553235:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722102784 00000100:00100000:2.0:1789445872.553254:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722102784 00000100:00100000:2.0:1789445872.553304:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 113 00000100:00100000:2.0:1789445872.553313:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:10593:x1876369722102784:12345-192.168.206.59@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789445872.553374:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472568da lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.553391:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472568da lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.553414:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472568da lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.558843:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d472568e1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.558866:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d472568e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.558896:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d472568e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.558927:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472568e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.558937:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472568e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.558944:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472568e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445872.558987:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789445872.558992:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789445872.559005:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472568e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.559031:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472568da lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.559037:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472568da lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.560347:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472568da lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.560361:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445872.560366:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472568da lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.560375:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472568da lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.561359:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afe858f5c00) 00010000:00010000:2.0:1789445872.561365:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445872.561371:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472568da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.561379:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472568da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.562378:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d472568e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.562393:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d472568e1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.563127:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d472568e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.563133:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445872.563138:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d472568e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.563147:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d472568e1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.563163:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9afe90eacd00) 00010000:00010000:2.0:1789445872.563166:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445872.563170:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d472568e1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.563177:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d472568e1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.563220:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472568e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.563227:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472568e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.564495:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472568e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.564503:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445872.564507:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472568e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.564516:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472568e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.564530:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:2.0:1789445872.564533:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445872.564537:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472568e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.564544:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472568e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445872.564700:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:10593:x1876369722102784:12345-192.168.206.59@tcp:34:lhsmtool_posix.0 Request processed in 11382us (11611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445872.564710:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 113 00000100:00100000:1.0:1789445872.586678:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445872.586921:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722103040 00000100:00100000:2.0:1789445872.586931:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722103040 00000100:00100000:2.0:1789445872.586976:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 114 00000100:00100000:2.0:1789445872.586997:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:10593:x1876369722103040:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789445872.587017:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445872.587038:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472568ef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4cb8 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.587162:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472568f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.587178:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472568f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.587189:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472568f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445872.587200:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789445872.587297:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472568f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.587305:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472568f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.587313:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472568f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.587319:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bee00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445872.587322:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472568f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.587330:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472568f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.587341:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:2.0:1789445872.587351:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789445872.587358:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472568f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.587365:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472568f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.587421:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472568ef lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cb8 expref: 57 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.587441:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afe858f5c00) 00010000:00010000:2.0:1789445872.587444:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789445872.587448:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472568ef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cb8 expref: 57 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.587457:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57be200, rc 0) 00000100:00100000:2.0:1789445872.587509:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+56:10593:x1876369722103040:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 514us (840us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1789445872.587517:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 114 00000100:00100000:2.0:1789445872.593459:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445872.593794:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722103168 00000100:00100000:0.0:1789445872.593804:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722103168 00000100:00100000:0.0:1789445872.593860:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 115 00000100:00100000:0.0:1789445872.593869:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+56:10593:x1876369722103168:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789445872.593901:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789445872.594003:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+56:10593:x1876369722103168:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 Request processed in 134us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445872.594011:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 115 00000100:00100000:1.0:1789445872.602487:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445872.603536:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722103424 00000100:00100000:2.0:1789445872.603548:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722103424 00000100:00100000:2.0:1789445872.603599:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 116 00000100:00100000:2.0:1789445872.603610:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+56:10593:x1876369722103424:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789445872.603631:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445872.603634:0:8204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789445872.603658:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256894 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c9c expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.603706:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:2.0:1789445872.603712:0:8204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789445872.603726:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256904 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4cbf expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789445872.604628:0:8204:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789445872.617219:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d4725690b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.617242:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d4725690b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.617254:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d4725690b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.617319:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d47256904 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cbf expref: 58 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.617340:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d4725690b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cbf expref: 57 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.617350:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9afe8e97a100) 00010000:00010000:3.0:1789445872.617353:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789445872.617357:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fc000, rc 0) 00000100:00100000:3.0:1789445872.617868:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+57:10593:x1876369722103424:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 14257us (15387us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1789445872.617878:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 116 00000100:00100000:1.0:1789445872.659079:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445872.659199:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722103680 00000100:00100000:0.0:1789445872.659209:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722103680 00000100:00100000:0.0:1789445872.659266:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 117 00000100:00100000:0.0:1789445872.659275:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+57:10593:x1876369722103680:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789445872.659327:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445872.659350:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d4725690b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cbf expref: 57 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.659368:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9afe8e97a100) 00010000:00010000:0.0:1789445872.659378:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789445872.659662:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256919 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.659704:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256919 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.659715:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256919 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.659731:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256920 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7285eec7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.659738:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256920 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7285eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.659744:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256920 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7285eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.659953:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256919 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.659961:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256919 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.659968:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256919 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.659974:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445872.659978:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256919 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.659985:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256919 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.659994:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:0.0:1789445872.660004:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445872.660009:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256919 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.660015:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256919 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.660027:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256920 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7285eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.660032:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256920 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7285eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.660037:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256920 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7285eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.660145:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445872.660150:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256920 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7285eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.660156:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256920 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7285eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.660164:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7285eec7 (ffff9afe98961e00) 00010000:00010000:0.0:1789445872.660167:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445872.660170:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256920 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7285eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.660175:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256920 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7285eec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445872.660292:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+56:10593:x1876369722103680:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 Request processed in 1016us (1219us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789445872.660306:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 117 00000100:00100000:2.0:1789445872.670135:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445872.670453:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722103808 00000100:00100000:0.0:1789445872.670463:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722103808 00000100:00100000:0.0:1789445872.670521:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 118 00000100:00100000:0.0:1789445872.670531:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+56:10593:x1876369722103808:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789445872.670551:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445872.670571:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256927 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4cc6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.670603:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d4725692e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.670620:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d4725692e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.670632:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d4725692e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.670726:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256927 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cc6 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.670742:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d4725692e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cc6 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.670750:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:0.0:1789445872.670753:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789445872.670757:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906400, rc 0) 00000100:00100000:0.0:1789445872.670823:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+57:10593:x1876369722103808:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 293us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445872.670837:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 118 00000100:00100000:1.0:1789445872.678482:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445872.678589:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722104064 00000100:00100000:2.0:1789445872.678598:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722104064 00000100:00100000:2.0:1789445872.678652:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 119 00000100:00100000:2.0:1789445872.678663:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+57:10593:x1876369722104064:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789445872.678735:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256935 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.678765:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256935 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.678778:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256935 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789445872.679004:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1789445872.679013:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 310700967757ns, next at 311700965762ns, rc = 0 00000004:00010000:2.0:1789445872.679134:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0b339ea reply state 000000006268a6c5 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256935 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445872.679142:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789445872.679237:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:10593:x1876369722104064:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 Request processed in 575us (765us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789445872.679259:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 119 00010000:00010000:3.0:1789445872.684078:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256935 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.684093:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256935 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.684117:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256935 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.684123:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445872.684128:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256935 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.684136:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256935 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.684151:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:3.0:1789445872.684154:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789445872.684170:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256935 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.684177:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256935 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445872.687952:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445872.688080:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722104192 00000100:00100000:0.0:1789445872.688090:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722104192 00000100:00100000:0.0:1789445872.688142:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 120 00000100:00100000:0.0:1789445872.688164:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+58:10593:x1876369722104192:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789445872.688188:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445872.688208:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d4725693c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ccd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.688264:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d4725693c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ccd expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.688277:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d4725693c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ccd expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.688294:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:0.0:1789445872.688298:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789445872.688301:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907800, rc 0) 00000100:00100000:0.0:1789445872.688356:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:10593:x1876369722104192:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 205us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445872.688364:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 120 00000100:00100000:1.0:1789445872.695189:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445872.695409:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722104320 00000100:00100000:0.0:1789445872.695419:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722104320 00000100:00100000:0.0:1789445872.695507:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 37 00000100:00100000:0.0:1789445872.695518:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2377:x1876369722104320:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789445872.695803:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:2377:x1876369722104320:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 Request processed in 285us (621us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789445872.695824:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 37 00000100:00100000:3.0:1789445872.712957:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445872.715859:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722104576 00000100:00100000:0.0:1789445872.715879:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722104576 00000100:00100000:0.0:1789445872.715952:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 30 00000100:00100000:0.0:1789445872.715963:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:10593:x1876369722104576:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789445872.716242:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+60:10593:x1876369722104576:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 Request processed in 267us (3279us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789445872.716250:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 30 00000100:00100000:2.0:1789445872.721133:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445872.721225:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722104832 00000100:00100000:0.0:1789445872.721244:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722104832 00000100:00100000:0.0:1789445872.721303:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 121 00000100:00100000:0.0:1789445872.721313:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+60:10593:x1876369722104832:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789445872.721421:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+60:10593:x1876369722104832:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 Request processed in 109us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445872.721436:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 121 00000100:00100000:1.0:1789445872.728573:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445872.728657:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722104960 00000100:00100000:3.0:1789445872.728666:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722104960 00000100:00100000:3.0:1789445872.728723:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 122 00000100:00100000:3.0:1789445872.728733:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+60:10593:x1876369722104960:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789445872.728751:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445872.728770:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256943 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4cd4 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.728837:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725694a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.728869:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725694a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.728880:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725694a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445872.728916:0:8204:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789445872.728933:0:8204:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725694a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.728958:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256943 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cd4 expref: 62 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.728975:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725694a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cd4 expref: 61 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.728983:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:3.0:1789445872.728986:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789445872.728990:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fd200, rc 0) 00000100:00100000:3.0:1789445872.729102:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+61:10593:x1876369722104960:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 370us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445872.729109:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 122 00000100:00100000:2.0:1789445872.734172:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445872.734270:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722105088 00000100:00100000:1.0:1789445872.734279:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722105088 00000100:00100000:1.0:1789445872.734334:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 38 00000100:00100000:1.0:1789445872.734344:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:2374:x1876369722105088:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789445872.734362:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445872.734382:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032f8e303/0xc1b37c4d47256951 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4cdb expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789445872.734410:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa8c6f0, blocks: 0x1 00010000:00010000:1.0:1789445872.734437:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=310s v=(0 0) 00010000:00010000:1.0:1789445872.734442:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445872.734457:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032f8e303/0xc1b37c4d47256951 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cdb expref: 10 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.734476:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032f8e303/0xc1b37c4d47256951 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cdb expref: 10 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.734490:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6ec00, rc 0) 00000100:00100000:1.0:1789445872.734547:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+10:2374:x1876369722105088:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 205us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445872.734555:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 38 00000100:00100000:2.0:1789445872.741731:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445872.741870:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722105344 00000100:00100000:0.0:1789445872.741880:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722105344 00000100:00100000:0.0:1789445872.741935:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 123 00000100:00100000:0.0:1789445872.741945:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+61:10593:x1876369722105344:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789445872.742081:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+61:10593:x1876369722105344:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 Request processed in 137us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445872.742087:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 123 00000100:00100000:1.0:1789445872.746634:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445872.746710:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722105472 00000100:00100000:0.0:1789445872.746718:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722105472 00000100:00100000:0.0:1789445872.746790:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 39 00000100:00100000:0.0:1789445872.746799:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+10:10593:x1876369722105472:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789445872.746815:0:11692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445872.746831:0:11692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d47256958 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ce2 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.746861:0:11692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032f8e303/0xc1b37c4d47256951 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cdb expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.746871:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445872.746875:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445872.746881:0:11692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d47256958 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ce2 expref: 11 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.746911:0:11692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032f8e303/0xc1b37c4d47256951 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cdb expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.746925:0:11692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032f8e303/0xc1b37c4d47256951 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cdb expref: 11 pid: 6685 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445872.746939:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba656680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11692:1876369742039296:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445872.747030:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea485b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789445872.752112:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba656680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11692:1876369742039296:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789445872.752158:0:11692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d47256958 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ce2 expref: 11 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.752199:0:11692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907200, rc 0) 00000100:00100000:0.0:1789445872.752270:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+11:10593:x1876369722105472:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 5471us (5643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445872.752278:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 39 00000100:00100000:3.0:1789445872.756641:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445872.756815:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722105600 00000100:00100000:1.0:1789445872.756824:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722105600 00010000:00010000:1.0:1789445872.756865:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000032f8e303/0xc1b37c4d47256951 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cdb expref: 11 pid: 6685 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445872.756905:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 56 00000100:00100000:1.0:1789445872.756915:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+11:2375:x1876369722105600:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789445872.756929:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445872.756952:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000032f8e303/0xc1b37c4d47256951 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cdb expref: 11 pid: 6685 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.756966:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000032f8e303/0xc1b37c4d47256951 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cdb expref: 11 pid: 6685 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.756987:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032f8e303/0xc1b37c4d47256951 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cdb expref: 11 pid: 6685 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.757019:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445872.757023:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445872.757031:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d47256958 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ce2 expref: 10 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.757041:0:7627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d47256958 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ce2 expref: 10 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.757137:0:7627:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d47256958 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ce2 expref: 10 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445872.757152:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf614000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7627:1876369742039424:192.168.206.59@tcp:105: 00000100:00100000:1.0:1789445872.757225:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87ddef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789445872.771109:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf614000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7627:1876369742039424:192.168.206.59@tcp:105: 00010000:00010000:1.0:1789445872.771138:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445872.771197:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+10:2375:x1876369722105600:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 14282us (14563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445872.771207:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 56 00000100:00100000:0.0:1789445872.774659:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445872.776661:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722105728 00000100:00100000:3.0:1789445872.776676:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722105728 00002000:00100000:3.0:1789445872.776727:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9afeba656680 x1876369722105728/t0(0) o4->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:753/0 lens 504/0 e 0 to 0 dl 1789445883 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789445872.776738:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afeba656680 with x1876369722105728 ext(0->12) 00002000:00010000:3.0:1789445872.776757:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afeba656680 00000100:00100000:3.0:1789445872.776805:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 2 00000100:00100000:3.0:1789445872.776815:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+10:2374:x1876369722105728:12345-192.168.206.59@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789445872.777261:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+12:2374:x1876369722105728:12345-192.168.206.59@tcp:4:lhsmtool_posix.0 Request processed in 446us (2610us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789445872.777270:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 2 00002000:00100000:3.0:1789445872.777276:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9afeba656680 x1876369722105728/t4294967308(0) o4->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:753/0 lens 504/448 e 0 to 0 dl 1789445883 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789445872.777285:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afeba656680 with x1876369722105728 ext(0->12) 00002000:00010000:3.0:1789445872.777288:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afeba656680 00000100:00100000:3.0:1789445872.792155:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445872.792816:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722105856 00000100:00100000:2.0:1789445872.792826:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722105856 00000100:00100000:2.0:1789445872.792892:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 124 00000100:00100000:2.0:1789445872.792902:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+61:10593:x1876369722105856:12345-192.168.206.59@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789445872.849116:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1789445872.849170:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1789445872.849202:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1789445872.849218:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9afeba1d29c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789445872.849223:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afe919a8900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9afeba1d2d80 00000020:00080000:0.0:1789445872.849226:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afe919a8300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9afeba7ab400 00000004:00080000:0.0:1789445872.849255:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789445872.849267:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9afeada9eb40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789445872.849270:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afe85f60d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9afe90c51240 00000020:00080000:0.0:1789445872.849273:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afe85f60b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9afeb9c5a800 00000020:00080000:0.0:1789445872.849469:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1789445872.849627:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789445872.849647:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742039552:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789445872.849709:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445872.850088:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789445872.850096:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742039680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789445872.850122:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445872.850157:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742039808:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789445872.850195:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445872.850376:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742039552 00000100:00100000:2.0:1789445872.850384:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742039552 00000100:00100000:2.0:1789445872.850777:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742039680 00000100:00100000:2.0:1789445872.850783:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742039680 00000100:00100000:0.0:1789445872.850911:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742039808 00000100:00100000:0.0:1789445872.850916:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742039808 00000100:00100000:0.0:1789445872.850938:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789445872.850946:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1876369742039552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789445872.850971:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1789445872.850995:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d4725695f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.851016:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256721 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c41 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.851025:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789445872.851029:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789445872.851033:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d4725695f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445872.851130:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789445872.851140:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1876369742039680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789445872.851292:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789445872.851296:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789445872 00002000:00010000:1.0:1789445872.851298:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789445872.851300:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789445872 -> 1789445872 00002000:00010000:1.0:1789445872.851311:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789445872.851363:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3312:x1876369742039680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 225us (1240us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789445872.851370:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789445872.851388:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789445872.851393:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1876369742039808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789445872.851406:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1789445872.851436:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa8c6ee, atime: 0x6aa8c6ef, ctime: 0x6aa8c6ee, blocks: 0x1 00010000:00010000:1.0:1789445872.851442:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47256966 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.851451:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=310s v=(0 0) 00010000:00010000:1.0:1789445872.851454:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445872.851459:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47256966 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.851474:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47256966 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.851484:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47256966 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.851491:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47256966 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.851508:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789445872.851957:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1876369742039808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 562us (1759us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789445872.851971:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789445872.852082:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:10593:x1876369722105856:12345-192.168.206.59@tcp:44:lhsmtool_posix.0 Request processed in 59180us (59936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445872.852091:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 124 00000100:00080000:3.0:1789445872.852403:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789445872.852492:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256721 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c41 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.852509:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256721 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c41 expref: 11 pid: 6682 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445872.852522:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876369742039936:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445872.852567:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea485b480 going to sleep for 11 seconds 00010000:00010000:0.0:1789445872.852581:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445872.852595:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47256966 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.852602:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6ec00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445872.852606:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47256966 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.852616:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47256966 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.852632:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47256966 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.852638:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47256966 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.852657:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445872.852659:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445872.852661:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789445872.852961:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afead8fe300/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789445872.852969:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742039808:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789445872.852998:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afe8a304380/2, rc 0, transno 4294967309 00000100:00100000:0.0:1789445872.853004:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742039680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789445872.859111:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445872.859161:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445872.859237:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722105984 00000100:00100000:3.0:1789445872.859246:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722105984 00010000:00010000:3.0:1789445872.859280:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256721 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c41 expref: 12 pid: 6682 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445872.859318:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 57 00000100:00100000:3.0:1789445872.859326:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf614000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+12:2375:x1876369722105984:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445872.859339:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445872.859344:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256721 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c41 expref: 12 pid: 6682 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.859357:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256721 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c41 expref: 12 pid: 6682 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.859393:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789445872.859397:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789445872.859403:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d4725695f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.859430:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d4725695f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.859451:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445872.859499:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf614000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+12:2375:x1876369722105984:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 173us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445872.859507:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 57 00000100:00100000:2.0:1789445872.860787:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722106112 00000100:00100000:2.0:1789445872.860797:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722106112 00000100:00100000:2.0:1789445872.860850:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 43 00000100:00100000:2.0:1789445872.860858:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+12:2375:x1876369722106112:12345-192.168.206.59@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1789445872.861894:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256721 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c41 expref: 12 pid: 6682 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445872.861916:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876369742039936:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789445872.861950:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d4725695f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.867309:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d4725695f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.867328:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d4725695f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.867341:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d4725695f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.867350:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d4725695f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.867372:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789445872.867887:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3312:x1876369742039552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16937us (18174us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789445872.867896:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1789445872.867927:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445872.867934:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d4725695f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.867944:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445872.867948:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d4725695f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.867971:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d4725695f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.867991:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d4725695f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.867999:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d4725695f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.868018:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445872.868020:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445872.868021:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789445872.868079:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afeba656300/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789445872.868086:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742039552:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1789445872.895098:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1789445872.895121:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1789445872.895149:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:3.0:1789445872.895385:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2375:x1876369722106112:12345-192.168.206.59@tcp:16:lhsmtool_posix.0 Request processed in 34522us (36218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445872.895396:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 43 00000100:00100000:1.0:1789445872.899094:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445872.899181:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722106368 00000100:00100000:0.0:1789445872.899191:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722106368 00000100:00100000:0.0:1789445872.899348:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 125 00000100:00100000:0.0:1789445872.899359:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:10593:x1876369722106368:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789445872.899409:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445872.899482:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d4725694a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cd4 expref: 15 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.899504:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:0.0:1789445872.899508:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789445872.899535:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d4725696d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.899679:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d4725696d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.899693:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d4725696d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789445872.899923:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062bd9c6b reply state 00000000f3958349 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d4725696d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445872.899933:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789445872.900241:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+16:10593:x1876369722106368:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 Request processed in 881us (1153us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789445872.900249:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 125 00010000:00010000:3.0:1789445872.902756:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d4725696d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.902845:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d4725696d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.902853:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d4725696d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.902859:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445872.902864:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d4725696d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.902890:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d4725696d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.902906:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:3.0:1789445872.902909:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445872.902914:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d4725696d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.902921:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d4725696d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445872.905607:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445872.905986:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722106496 00000100:00100000:0.0:1789445872.905996:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722106496 00000100:00100000:0.0:1789445872.906165:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 44 00000100:00100000:0.0:1789445872.906175:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2375:x1876369722106496:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789445872.907970:0:11692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789445872.907979:0:11692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789445872 -> 1789445871 00002000:00010000:0.0:1789445872.907982:0:11692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789445871 00002000:00010000:0.0:1789445872.907984:0:11692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789445872 -> 1789445871 00002000:00010000:0.0:1789445872.907987:0:11692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789445872.908333:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2375:x1876369722106496:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 Request processed in 2153us (2733us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789445872.908344:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 44 00000100:00100000:0.0:1789445872.910872:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445872.910977:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722106752 00000100:00100000:1.0:1789445872.910986:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722106752 00000100:00100000:1.0:1789445872.911149:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 126 00000100:00100000:1.0:1789445872.911161:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:10593:x1876369722106752:12345-192.168.206.59@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789445872.911227:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256974 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.911244:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d4725692e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cc6 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.911255:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256974 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.911288:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d4725692e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cc6 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.911302:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d4725692e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cc6 expref: 15 pid: 5842 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445872.911337:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742040064:192.168.206.59@tcp:104: 00000100:00100000:1.0:1789445872.911451:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87dde180 going to sleep for 11 seconds 00000100:00100000:1.0:1789445872.914739:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445872.914854:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742040064:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789445872.914891:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256974 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445872.916102:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722106880 00000100:00100000:3.0:1789445872.916113:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722106880 00010000:00010000:3.0:1789445872.916156:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d4725692e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cc6 expref: 16 pid: 5842 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445872.916247:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 58 00000100:00100000:3.0:1789445872.916257:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5758a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+16:2375:x1876369722106880:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445872.916271:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445872.916279:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d4725692e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cc6 expref: 16 pid: 5842 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.916290:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d4725692e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cc6 expref: 16 pid: 5842 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.916310:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d4725692e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cc6 expref: 16 pid: 5842 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.916341:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:3.0:1789445872.916347:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256974 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.916357:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.916365:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256974 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445872.916614:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445872.916681:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5758a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:2375:x1876369722106880:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 424us (1948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445872.916690:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 58 00010000:00010000:0.0:1789445872.918793:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.918810:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.918841:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.918848:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256974 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.918855:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256974 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.918861:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6fa00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445872.918865:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256974 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.918871:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256974 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.918887:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:0.0:1789445872.918890:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789445872.918894:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256974 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.918900:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256974 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445872.919010:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:10593:x1876369722106752:12345-192.168.206.59@tcp:55:lhsmtool_posix.0 Request processed in 7848us (8143us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789445872.919020:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 126 00000100:00100000:1.0:1789445872.921609:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445872.921689:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722107008 00000100:00100000:0.0:1789445872.921699:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722107008 00000100:00100000:0.0:1789445872.921855:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 45 00000100:00100000:0.0:1789445872.921865:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2375:x1876369722107008:12345-192.168.206.59@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789445872.921911:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d127c18a/0xc1b37c4d4725697b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.921930:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d47256958 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ce2 expref: 7 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.921942:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445872.921946:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789445872.921951:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d127c18a/0xc1b37c4d4725697b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.921983:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d47256958 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ce2 expref: 7 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.921997:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d47256958 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ce2 expref: 7 pid: 11692 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445872.922011:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba0f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876369742040192:192.168.206.59@tcp:104: 00000100:00100000:1.0:1789445872.922314:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea485b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789445872.924905:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445872.925170:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722107136 00000100:00100000:0.0:1789445872.925179:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722107136 00010000:00010000:0.0:1789445872.925217:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d47256958 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ce2 expref: 8 pid: 11692 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445872.925323:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 59 00000100:00100000:0.0:1789445872.925333:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2374:x1876369722107136:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789445872.925348:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789445872.925353:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba0f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876369742040192:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789445872.925370:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d47256958 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ce2 expref: 8 pid: 11692 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.925375:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d127c18a/0xc1b37c4d4725697b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.925382:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d47256958 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ce2 expref: 8 pid: 11692 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.925402:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d47256958 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ce2 expref: 8 pid: 11692 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.925500:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789445872.925505:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789445872.925511:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d127c18a/0xc1b37c4d4725697b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.925522:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d127c18a/0xc1b37c4d4725697b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.925599:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445872.925668:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2374:x1876369722107136:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 336us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445872.925676:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 59 00010000:00010000:1.0:1789445872.926169:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d127c18a/0xc1b37c4d4725697b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.926182:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d127c18a/0xc1b37c4d4725697b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.926207:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d127c18a/0xc1b37c4d4725697b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.926215:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d127c18a/0xc1b37c4d4725697b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.926223:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d127c18a/0xc1b37c4d4725697b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.926241:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907000 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445872.926245:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d127c18a/0xc1b37c4d4725697b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.926253:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d127c18a/0xc1b37c4d4725697b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.926265:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d127c18a/0xc1b37c4d4725697b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.926271:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d127c18a/0xc1b37c4d4725697b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445872.926329:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2375:x1876369722107008:12345-192.168.206.59@tcp:1:lhsmtool_posix.0 Request processed in 4465us (4728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445872.926336:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 45 00000100:00100000:3.0:1789445872.929636:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445872.929711:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722107392 00000100:00100000:0.0:1789445872.929720:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722107392 00000100:00100000:0.0:1789445872.929784:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 127 00000100:00100000:0.0:1789445872.929794:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:10593:x1876369722107392:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789445872.929866:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256982 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.929884:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.929895:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.930145:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256989 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.930156:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d4725693c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ccd expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.930164:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256989 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.930196:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d4725693c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ccd expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.930210:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d4725693c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ccd expref: 15 pid: 5842 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445872.930251:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba0f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742040320:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445872.930322:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea485b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445872.934128:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba0f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742040320:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445872.934140:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00010000:00010000:0.0:1789445872.934156:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256989 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445872.934275:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722107520 00000100:00100000:1.0:1789445872.934282:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722107520 00010000:00010000:1.0:1789445872.934319:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d4725693c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ccd expref: 16 pid: 5842 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445872.934359:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 60 00000100:00100000:1.0:1789445872.934369:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+16:2374:x1876369722107520:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789445872.934382:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445872.934389:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d4725693c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ccd expref: 16 pid: 5842 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.934438:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d4725693c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ccd expref: 16 pid: 5842 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.934458:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d4725693c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ccd expref: 16 pid: 5842 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.934473:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:1.0:1789445872.934477:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256989 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.934608:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256989 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.934616:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256989 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.934645:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789445872.934827:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256989 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.934835:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256989 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445872.934873:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:2374:x1876369722107520:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 505us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445872.934881:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 60 00000001:00080000:1.0:1789445872.935250:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1789445872.935570:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1789445872.935616:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1789445872.935830:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876369742040448:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789445872.935877:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445872.935916:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87ddee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789445872.935939:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742040448 00000100:00100000:2.0:1789445872.935947:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742040448 00000100:00100000:2.0:1789445872.935980:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789445872.935985:0:5845:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789445872.935987:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1876369742040448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789445872.935991:0:5845:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789445872.936079:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1876369742040448:12345-0@lo:1000:mdt00_001.0 Request processed in 91us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445872.936095:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789445872.937366:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1789445872.937377:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1789445872.937395:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afe8a304380, transno 4294967309 00000100:00100000:1.0:1789445872.937412:0:5841:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9afeba656300 x1876369742039552/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789445888 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445872.937434:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876369742040448:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789445872.938249:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1789445872.938329:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876369742040576:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789445872.938382:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445872.938408:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87dde300 going to sleep for 11 seconds 00000100:00100000:3.0:1789445872.938547:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742040576 00000100:00100000:3.0:1789445872.938554:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742040576 00000100:00100000:3.0:1789445872.938587:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789445872.938595:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1876369742040576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789445872.938981:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5841:x1876369742040576:12345-0@lo:1000:mdt00_001.0 Request processed in 386us (597us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789445872.938989:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789445872.939090:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876369742040576:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789445872.939124:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256989 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.939134:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256989 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.939141:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256989 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.939147:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445872.939150:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256989 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.939157:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256989 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.939172:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:1.0:1789445872.939175:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789445872.939189:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256989 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.939196:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256989 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.939224:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472568cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.939243:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472568cc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.939249:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472568cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.939254:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445872.939257:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472568cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.939263:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472568cc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.939271:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:1.0:1789445872.939273:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789445872.939280:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d472568d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cb1 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.939291:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d472568d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cb1 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.939300:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d472568d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cb1 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.939338:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d472568d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cb1 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445872.939349:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742040704:192.168.206.59@tcp:105: 00000100:00100000:1.0:1789445872.939414:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87dde300 going to sleep for 11 seconds 00000100:00100000:3.0:1789445872.942860:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445872.943015:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb575b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742040704:192.168.206.59@tcp:105: 00010000:00010000:1.0:1789445872.943042:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472568cc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943078:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472568cc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943110:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256990 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943123:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256990 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943134:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256990 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943144:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256990 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943151:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256990 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943158:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256990 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943179:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6ec00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445872.943183:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256990 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943190:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256990 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943203:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:1.0:1789445872.943206:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445872.943210:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256990 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943215:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256990 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943225:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943245:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256982 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943250:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256982 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943255:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445872.943258:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256982 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943264:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256982 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943286:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:1.0:1789445872.943288:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789445872.943291:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256982 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.943297:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256982 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445872.943499:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:10593:x1876369722107392:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 Request processed in 13705us (13871us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1789445872.943509:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 127 00000020:00080000:1.0:1789445872.943515:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789445872.943611:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722107648 00000100:00100000:0.0:1789445872.943618:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722107648 00000100:00100000:0.0:1789445872.943665:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 31 00000100:00100000:0.0:1789445872.943674:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:10591:x1876369722107648:12345-192.168.206.59@tcp:49:lfs.0 00000100:00100000:0.0:1789445872.943756:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:10591:x1876369722107648:12345-192.168.206.59@tcp:49:lfs.0 Request processed in 83us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445872.943835:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 31 00000040:00080000:3.0:1789445872.944101:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789445872.944106:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789445872.944628:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789445872.944646:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789445872.948620:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445872.948713:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722107904 00000100:00100000:2.0:1789445872.948723:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722107904 00000100:00100000:2.0:1789445872.948784:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 32 00000100:00100000:2.0:1789445872.948794:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c02850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:10593:x1876369722107904:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789445872.949900:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789445872.950002:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1789445872.950094:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256997 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.950109:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256997 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.950120:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256997 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.950129:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256997 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.950136:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256997 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.950142:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256997 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445872.950164:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789445872.950395:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445872.950402:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256997 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.950409:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6f200 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445872.950413:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256997 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.950441:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256997 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.950454:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:0.0:1789445872.950457:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789445872.950461:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256997 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.950467:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256997 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445872.950481:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445872.950483:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445872.950485:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445872.950587:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c02850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:10593:x1876369722107904:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 Request processed in 1791us (1973us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789445872.950598:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 32 00000020:00080000:1.0:1789445872.950604:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789445872.954010:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445872.954157:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722108160 00000100:00100000:2.0:1789445872.954167:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722108160 00000100:00100000:2.0:1789445872.954225:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 128 00000100:00100000:2.0:1789445872.954243:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:10591:x1876369722108160:12345-192.168.206.59@tcp:58:lfs.0 00000040:00080000:2.0:1789445872.954631:0:8204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1789445872.954709:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:10591:x1876369722108160:12345-192.168.206.59@tcp:58:lfs.0 Request processed in 468us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445872.954717:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 128 00000100:00100000:3.0:1789445872.994738:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445872.994816:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722108288 00000100:00100000:2.0:1789445872.994826:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722108288 00000100:00100000:2.0:1789445872.994884:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 129 00000100:00100000:2.0:1789445872.994893:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:10595:x1876369722108288:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:2.0:1789445872.994915:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445872.994934:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725699e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ce9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.994995:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.995009:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.995039:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.995075:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472569ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.995083:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472569ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.995090:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472569ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.995299:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472569b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.995311:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4caa expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.995320:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472569b3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.995352:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4caa expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445872.995367:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4caa expref: 21 pid: 5842 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445872.995380:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742040832:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445872.995596:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4877180 going to sleep for 11 seconds 00000100:00100000:3.0:1789445873.003196:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445873.003269:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722108544 00000100:00100000:1.0:1789445873.003286:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722108544 00000100:00100000:2.0:1789445873.003325:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742040832:192.168.206.59@tcp:104: 00000100:00100000:1.0:1789445873.003334:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 33 00000100:00100000:1.0:1789445873.003347:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+22:5628:x1876369722108544:12345-192.168.206.59@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1789445873.003352:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472569b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445873.003616:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:5628:x1876369722108544:12345-192.168.206.59@tcp:35:ldlm_bl.0 Request processed in 272us (427us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1789445873.003625:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 33 00000100:00100000:0.0:1789445873.007346:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445873.007498:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722108672 00000100:00100000:2.0:1789445873.007508:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722108672 00010000:00010000:2.0:1789445873.007547:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4caa expref: 23 pid: 5842 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445873.007588:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 61 00000100:00100000:2.0:1789445873.007598:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe919b0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:2375:x1876369722108672:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445873.007613:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445873.007619:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4caa expref: 23 pid: 5842 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445873.007632:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4caa expref: 23 pid: 5842 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445873.007652:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d472568be lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4caa expref: 23 pid: 5842 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445873.007667:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:2.0:1789445873.007672:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472569b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445873.007680:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472569b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445873.007687:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472569b3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445873.007731:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445873.007860:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe919b0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+22:2375:x1876369722108672:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 262us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445873.007868:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 61 00010000:00010000:3.0:1789445873.008098:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472569b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008107:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472569b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445873.008149:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789445873.008154:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789445873.008174:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472569b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008187:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472569b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008197:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008204:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008211:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008216:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445873.008220:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008227:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008249:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:3.0:1789445873.008252:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445873.008256:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008262:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008274:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472569ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008280:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472569ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008285:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472569ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008290:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bee00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445873.008293:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472569ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008298:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472569ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008305:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9afe90eacd00) 00010000:00010000:3.0:1789445873.008307:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445873.008309:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472569ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008315:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d472569ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008359:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725699e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ce9 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008373:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472569b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ce9 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445873.008380:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:3.0:1789445873.008382:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789445873.008384:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57be200, rc 0) 00000100:00100000:2.0:1789445873.008738:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:10595:x1876369722108288:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 13845us (14008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445873.008747:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 129 00010000:00010000:3.0:1789445873.372848:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445873.755273:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742041088:0@lo:400:kworker.0 00000100:00100000:2.0:1789445873.755360:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445873.755427:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742041600:0@lo:400:kworker.0 00000100:00100000:2.0:1789445873.755458:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445873.755490:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789445873.755496:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742041216:0@lo:400:kworker.0 00000100:00100000:2.0:1789445873.755524:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445873.755560:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742041088 00000100:00100000:2.0:1789445873.755674:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742041088 00000100:00100000:2.0:1789445873.755725:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742041216 00000100:00100000:2.0:1789445873.755729:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742041216 00000100:00100000:3.0:1789445873.755852:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742040960:0@lo:400:kworker.0 00000100:00100000:3.0:1789445873.755892:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445873.755919:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742041472:0@lo:400:kworker.0 00000100:00100000:3.0:1789445873.755942:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445873.755955:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789445873.755961:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742041344:0@lo:400:kworker.0 00000100:00100000:3.0:1789445873.755983:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445873.756013:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742041600 00000100:00100000:3.0:1789445873.756018:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742041600 00000100:00100000:1.0:1789445873.756317:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742041472 00000100:00100000:1.0:1789445873.756323:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742041472 00000100:00100000:2.0:1789445873.756669:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789445873.756682:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742041088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445873.756764:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789445873.756773:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742041216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445873.756812:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742041216:12345-0@lo:400:kworker.0 Request processed in 41us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445873.756819:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789445873.756821:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742041088:12345-0@lo:400:kworker.0 Request processed in 143us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445873.756827:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789445873.756839:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789445873.756845:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369742041472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445873.756881:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369742041472:12345-0@lo:400:kworker.0 Request processed in 37us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445873.756957:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742041216:0@lo:400:kworker.0 00000100:00100000:0.0:1789445873.756976:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742041088:0@lo:400:kworker.0 00000100:00100000:3.0:1789445873.757089:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742041344 00000100:00100000:3.0:1789445873.757095:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742041344 00000100:00100000:3.0:1789445873.757188:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789445873.757195:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1876369742041600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445873.757242:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1876369742041600:12345-0@lo:400:kworker.0 Request processed in 48us (1784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445873.757248:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789445873.757270:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789445873.757275:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1876369742041344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445873.757299:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1876369742041344:12345-0@lo:400:kworker.0 Request processed in 25us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445873.757304:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1789445873.757319:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789445873.757324:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445873.757333:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742040960 00000100:00100000:3.0:1789445873.757337:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742040960 00000100:00100000:3.0:1789445873.757363:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789445873.757369:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742040960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445873.757398:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742040960:12345-0@lo:400:kworker.0 Request processed in 29us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445873.757405:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789445873.757469:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742041344:0@lo:400:kworker.0 00000100:00100000:3.0:1789445873.757479:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742040960:0@lo:400:kworker.0 00000100:00100000:3.0:1789445873.757491:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742041472:0@lo:400:kworker.0 00000100:00100000:3.0:1789445873.757525:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742041600:0@lo:400:kworker.0 00000100:00100000:1.0:1789445873.757734:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000040:00080000:3.0:1789445873.946316:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789445873.946325:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789445873.946363:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789445873.946369:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789445873.946492:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1876369742041728:192.168.206.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789445873.946624:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789445873.973439:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445873.973488:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1876369742041728:192.168.206.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789445873.973615:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722108800 00000100:00100000:0.0:1789445873.973622:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722108800 00000100:00100000:0.0:1789445873.973665:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 130 00000100:00100000:0.0:1789445873.973674:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:10606:x1876369722108800:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789445873.973702:0:8204:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789445873.973789:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:10606:x1876369722108800:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 Request processed in 115us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445873.973803:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 130 00000040:00080000:3.0:1789445873.977973:0:12100:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789445873.977988:0:12100:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789445873.978037:0:12100:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789445873.979894:0:12100:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789445873.981680:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445873.981720:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722109056 00000100:00100000:0.0:1789445873.981729:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722109056 00000100:00100000:0.0:1789445873.981785:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 131 00000100:00100000:0.0:1789445873.981796:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:10606:x1876369722109056:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789445873.981818:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445873.981837:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472569ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4cf0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445873.981947:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906600/0xc1b37c4d472569c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445873.981962:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906600/0xc1b37c4d472569c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445873.981975:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906600/0xc1b37c4d472569c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445873.981987:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789445873.982155:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d472569ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cf0 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445873.982175:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906600/0xc1b37c4d472569c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cf0 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445873.982185:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:0.0:1789445873.982189:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789445873.982207:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906600, rc 0) 00000100:00100000:0.0:1789445873.982304:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:10606:x1876369722109056:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 508us (629us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789445873.982314:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 131 00000100:00100000:3.0:1789445873.988596:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445873.988692:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722109312 00000100:00100000:2.0:1789445873.988702:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722109312 00000100:00100000:2.0:1789445873.988753:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 132 00000100:00100000:2.0:1789445873.988786:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:10606:x1876369722109312:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789445873.988861:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472569cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445873.988877:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472569cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445873.988889:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472569cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445873.989091:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472569cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445873.989099:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472569cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445873.989106:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472569cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445873.989111:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445873.989115:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472569cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445873.989122:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472569cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445873.989133:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:2.0:1789445873.989136:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789445873.989141:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472569cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445873.989147:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d472569cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445873.989293:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:10606:x1876369722109312:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 Request processed in 510us (705us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789445873.989301:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 132 00000040:00080000:2.0:1789445873.989407:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789445873.989412:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789445873.989948:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789445873.989958:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789445873.992141:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445873.992237:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722109440 00000100:00100000:0.0:1789445873.992246:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722109440 00000100:00100000:0.0:1789445873.992304:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 8 00000100:00100000:0.0:1789445873.992314:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:2374:x1876369722109440:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789445873.992328:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445873.992350:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906600/0xc1b37c4d472569c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cf0 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445873.992366:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:0.0:1789445873.992371:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445873.992415:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:2374:x1876369722109440:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 103us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445873.992433:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 8 00000100:00100000:2.0:1789445873.997872:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445873.998076:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722109696 00000100:00100000:1.0:1789445873.998095:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722109696 00000100:00100000:1.0:1789445873.998145:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 34 00000100:00100000:1.0:1789445873.998153:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:10606:x1876369722109696:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789445873.998376:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:10606:x1876369722109696:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 Request processed in 223us (510us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789445873.998383:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 34 00000100:00100000:0.0:1789445874.266574:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789445874.266607:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742041856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789445874.266671:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445874.266778:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742041856 00000100:00100000:1.0:1789445874.266786:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742041856 00000100:00100000:1.0:1789445874.266864:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789445874.266874:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1876369742041856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789445874.266907:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445874.266961:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1876369742041856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445874.266967:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789445874.266980:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742041856:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789445874.267091:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789445874.394376:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789445874.858866:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1789445874.859004:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:0.0:1789445875.419041:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789445876.062580:0:12153:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789445876.062589:0:12153:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789445876.062632:0:12153:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789445876.062637:0:12153:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789445876.308838:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445876.309080:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722109952 00000100:00100000:1.0:1789445876.309093:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722109952 00000100:00100000:1.0:1789445876.309172:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 133 00000100:00100000:1.0:1789445876.309182:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:10628:x1876369722109952:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:1.0:1789445876.309219:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445876.309241:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d472569d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4cf7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445876.309340:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472569dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445876.309365:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472569dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445876.309377:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472569dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445876.309391:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789445876.309542:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d472569d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cf7 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445876.309792:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472569dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cf7 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445876.309802:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:1.0:1789445876.309805:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789445876.309809:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6e600, rc 0) 00000100:00100000:1.0:1789445876.309874:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+26:10628:x1876369722109952:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 694us (1046us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789445876.309881:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 133 00000100:00080000:3.0:1789445876.313361:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445876.318327:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445876.318363:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722110080 00000100:00100000:2.0:1789445876.318373:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722110080 00000100:00100000:2.0:1789445876.318436:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 134 00000100:00100000:2.0:1789445876.318447:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+26:10628:x1876369722110080:12345-192.168.206.59@tcp:54:lfs.0 00010000:00010000:2.0:1789445876.318521:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445876.318540:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445876.318551:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445876.318577:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445876.318583:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445876.318604:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445876.318610:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445876.318615:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445876.318623:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445876.318636:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:2.0:1789445876.318639:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789445876.318644:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445876.318650:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d472569eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445876.318737:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+26:10628:x1876369722110080:12345-192.168.206.59@tcp:54:lfs.0 Request processed in 292us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445876.318744:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 134 00010000:00010000:3.0:1789445876.442879:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445876.490208:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445876.490398:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722110208 00000100:00100000:3.0:1789445876.490417:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722110208 00000100:00100000:3.0:1789445876.490485:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 46 00000100:00100000:3.0:1789445876.490495:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2375:x1876369722110208:12345-192.168.206.59@tcp:101:cat.0 00010000:00010000:3.0:1789445876.490512:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445876.490531:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f36dd97/0xc1b37c4d472569f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4cfe expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789445876.490557:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa8c6ef, atime: 0x6aa8c6ef, ctime: 0x6aa8c6ef, blocks: 0xb 00010000:00010000:3.0:1789445876.490574:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=314s v=(0 0) 00010000:00010000:3.0:1789445876.490579:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445876.490588:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f36dd97/0xc1b37c4d472569f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cfe expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445876.490605:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007f36dd97/0xc1b37c4d472569f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cfe expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445876.490617:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fc600, rc 0) 00000100:00100000:3.0:1789445876.490682:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2375:x1876369722110208:12345-192.168.206.59@tcp:101:cat.0 Request processed in 189us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445876.490700:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 46 00000100:00080000:0.0:1789445876.491010:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789445876.494641:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445876.496482:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722110336 00000100:00100000:0.0:1789445876.496613:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722110336 00002000:00100000:0.0:1789445876.496686:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9afebffc2680 x1876369722110336/t0(0) o3->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:2/0 lens 488/0 e 0 to 0 dl 1789445887 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789445876.496699:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afebffc2680 with x1876369722110336 ext(0->4095) 00002000:00010000:0.0:1789445876.496705:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afebffc2680 00000100:00100000:0.0:1789445876.496819:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 3 00000100:00100000:0.0:1789445876.496832:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2376:x1876369722110336:12345-192.168.206.59@tcp:3:cat.0 00000100:00100000:0.0:1789445876.497170:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2376:x1876369722110336:12345-192.168.206.59@tcp:3:cat.0 Request processed in 340us (2541us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789445876.497178:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 3 00002000:00100000:0.0:1789445876.497185:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9afebffc2680 x1876369722110336/t0(0) o3->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:2/0 lens 488/4536 e 0 to 0 dl 1789445887 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789445876.497193:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afebffc2680 with x1876369722110336 ext(0->4095) 00002000:00010000:0.0:1789445876.497197:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afebffc2680 00000100:00100000:3.0:1789445876.829570:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789445876.829606:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742041984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789445876.829703:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445876.830028:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742041984 00000100:00100000:1.0:1789445876.830038:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742041984 00000100:00100000:1.0:1789445876.830161:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789445876.830174:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742041984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789445876.830231:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445876.830298:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742041984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445876.830331:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1789445876.831078:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445876.831118:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789445876.831126:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1789445876.831153:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afead8fe300, transno 4294967304 00000100:00100000:3.0:1789445876.831176:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742041984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789445877.288108:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445877.288151:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445877.288187:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445877.288215:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445877.288246:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722110592 00000100:00100000:2.0:1789445877.288259:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722110592 00000100:00100000:2.0:1789445877.288315:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722110848 00000100:00100000:2.0:1789445877.288319:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722110848 00000100:00100000:2.0:1789445877.288373:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 133 00000100:00100000:2.0:1789445877.288397:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+26:2375:x1876369722110592:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445877.288504:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+26:2375:x1876369722110592:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 109us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445877.288513:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 133 00000100:00100000:2.0:1789445877.288534:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 134 00000100:00100000:2.0:1789445877.288541:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:338e572d-37d9-47c3-87b6-4735cd889844+5:2375:x1876369722110848:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445877.288569:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:338e572d-37d9-47c3-87b6-4735cd889844+5:2375:x1876369722110848:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445877.288575:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 134 00000100:00080000:2.0:1789445877.288600:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445877.289038:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722110464 00000100:00100000:3.0:1789445877.289058:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722110464 00000100:00100000:3.0:1789445877.289103:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 287 00000100:00100000:3.0:1789445877.289111:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2375:x1876369722110464:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445877.289150:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2375:x1876369722110464:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 41us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445877.289158:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 287 00000100:00100000:1.0:1789445877.292977:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722110720 00000100:00100000:1.0:1789445877.292996:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722110720 00000100:00100000:1.0:1789445877.294232:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 76 00000100:00100000:1.0:1789445877.294251:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2375:x1876369722110720:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445877.294350:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2375:x1876369722110720:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 106us (6198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445877.294357:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 76 00000100:00080000:3.0:1789445877.294449:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789445877.466244:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789445877.962015:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:1.0:1789445877.962331:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1789445877.962366:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:0.0:1789445877.962389:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1789445877.962431:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1789445877.962453:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9afe87ddee40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789445877.962459:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afe9d5b5700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9afe87dde9c0 00000020:00080000:1.0:1789445877.962462:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afe9d5b5200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9afebb4f2000 00000020:00080000:0.0:1789445877.962493:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789445877.962821:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000040:00080000:2.0:1789445878.106269:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789445878.106281:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789445878.106324:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789445878.106335:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1789445878.456768:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1789445878.456795:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1789445878.456804:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:0.0:1789445878.494249:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445878.875830:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9192df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742042240:0@lo:400:kworker.0 00000100:00100000:3.0:1789445878.875858:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369742042368:0@lo:400:kworker.0 00000100:00100000:0.0:1789445878.875950:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742042112:0@lo:400:kworker.0 00000100:00100000:1.0:1789445878.875971:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742042496:0@lo:400:kworker.0 00000100:00100000:3.0:1789445878.877037:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445878.877143:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789445878.877152:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742042752:0@lo:400:kworker.0 00000100:00100000:3.0:1789445878.877214:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445878.877259:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742042368 00000100:00100000:3.0:1789445878.877268:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742042368 00000100:00100000:3.0:1789445878.877345:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789445878.877356:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369742042368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445878.877438:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369742042368:12345-0@lo:400:kworker.0 Request processed in 85us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445878.877446:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789445878.877807:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742042752 00000100:00100000:3.0:1789445878.877813:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742042752 00000100:00100000:3.0:1789445878.877853:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789445878.877859:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742042752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445878.877897:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742042752:12345-0@lo:400:kworker.0 Request processed in 38us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445878.877903:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1789445878.877924:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789445878.877929:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445878.877968:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1789445878.877974:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afeba656300, transno 4294967310 00000004:00080000:3.0:1789445878.877989:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1789445878.878018:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742042752:0@lo:400:kworker.0 00000100:00100000:3.0:1789445878.878030:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369742042368:0@lo:400:kworker.0 00000100:00100000:1.0:1789445878.883329:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445878.888404:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742042496 00000100:00100000:3.0:1789445878.888427:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742042496 00000100:00100000:3.0:1789445878.888920:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789445878.888935:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742042496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445878.889012:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789445878.889093:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445878.898931:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742042496:12345-0@lo:400:kworker.0 Request processed in 9980us (15592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445878.898954:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789445878.899137:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742042112 00000100:00100000:3.0:1789445878.899150:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742042112 00000100:00100000:3.0:1789445878.899332:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789445878.899344:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742042112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445878.902280:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742042496:0@lo:400:kworker.0 00000100:00100000:3.0:1789445878.902871:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742042112:12345-0@lo:400:kworker.0 Request processed in 3526us (13856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445878.902886:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789445878.903116:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445878.903442:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742042240 00000100:00100000:3.0:1789445878.903452:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742042240 00000100:00100000:3.0:1789445878.903516:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789445878.904347:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742042240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445878.904604:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742042240:12345-0@lo:400:kworker.0 Request processed in 269us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445878.904613:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789445878.911292:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742042112:0@lo:400:kworker.0 00000100:00100000:0.0:1789445878.911321:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742042624:0@lo:400:kworker.0 00000100:00100000:0.0:1789445878.911426:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445878.913250:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742042624 00000100:00100000:1.0:1789445878.913267:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742042624 00000100:00100000:1.0:1789445878.913387:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789445878.913408:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369742042624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445878.913553:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369742042624:12345-0@lo:400:kworker.0 Request processed in 148us (2127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445878.913561:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789445878.913638:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742042624:0@lo:400:kworker.0 00000100:00080000:0.0:1789445878.914068:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445878.916639:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9192df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742042240:0@lo:400:kworker.0 00000100:00100000:1.0:1789445879.392549:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742042880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789445879.392654:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445879.393307:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742042880 00000100:00100000:0.0:1789445879.393318:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742042880 00000100:00100000:0.0:1789445879.393386:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789445879.393408:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742042880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789445879.393462:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789445879.393537:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742042880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445879.393545:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789445879.393607:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742042880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789445879.515724:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445880.545912:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445881.562316:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445881.952671:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789445881.952700:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742043008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789445881.952777:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445881.952848:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742043008 00000100:00100000:1.0:1789445881.952856:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742043008 00000100:00100000:1.0:1789445881.952918:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789445881.952929:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742043008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789445881.952966:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445881.954488:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742043008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1554us (1703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445881.954503:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1789445881.954540:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789445881.956955:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742043008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789445882.406490:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445882.406541:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445882.406605:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445882.406643:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445882.406656:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722111232 00000100:00100000:0.0:1789445882.406673:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722111232 00000100:00100000:2.0:1789445882.406674:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445882.406756:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722111360 00000100:00100000:0.0:1789445882.406762:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722111360 00000100:00100000:2.0:1789445882.406787:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 79 00000100:00100000:2.0:1789445882.406806:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2376:x1876369722111232:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445882.406843:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722111488 00000100:00100000:1.0:1789445882.406850:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722111488 00000100:00100000:1.0:1789445882.406911:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722111104 00000100:00100000:2.0:1789445882.406916:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2376:x1876369722111232:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 115us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445882.406917:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722111104 00000100:00100000:1.0:1789445882.406952:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 138 00000100:00100000:1.0:1789445882.406966:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2376:x1876369722111488:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445882.406986:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722110976 00000100:00100000:3.0:1789445882.406996:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722110976 00000100:00100000:3.0:1789445882.407088:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 289 00000100:00100000:1.0:1789445882.407096:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2376:x1876369722111488:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 79us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445882.407100:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2376:x1876369722110976:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445882.407122:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 138 00000100:00100000:3.0:1789445882.407144:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2376:x1876369722110976:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 45us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445882.407154:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 139 00000100:00100000:3.0:1789445882.407159:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 289 00000100:00100000:1.0:1789445882.407177:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:2376:x1876369722111104:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445882.407227:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:2376:x1876369722111104:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 57us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445882.407237:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 139 00000100:00080000:1.0:1789445882.407263:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789445882.407270:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789445882.407274:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789445882.415318:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 80 00000100:00100000:0.0:1789445882.416250:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2376:x1876369722111360:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445882.416337:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2376:x1876369722111360:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 1006us (9663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445882.416424:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 80 00000100:00100000:2.0:1789445882.421848:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 79 00000100:00100000:2.0:1789445882.540594:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445882.540854:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722111616 00000100:00100000:3.0:1789445882.540867:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722111616 00000100:00100000:3.0:1789445882.540942:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 135 00000100:00100000:3.0:1789445882.540955:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:10271:x1876369722111616:12345-192.168.206.59@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789445882.541168:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:10271:x1876369722111616:12345-192.168.206.59@tcp:60:lhsmtool_posix.0 Request processed in 216us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445882.541177:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 135 00000100:00100000:3.0:1789445882.543353:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445882.543483:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722111872 00000100:00100000:1.0:1789445882.543497:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722111872 00000100:00100000:1.0:1789445882.543568:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 35 00000100:00100000:1.0:1789445882.543579:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:10271:x1876369722111872:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789445882.543930:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:10271:x1876369722111872:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 Request processed in 352us (586us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789445882.543938:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 35 00010000:00010000:3.0:1789445882.588294:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789445883.051891:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1789445883.052134:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789445883.052150:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:1.0:1789445883.052839:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00010000:00010000:3.0:1789445883.610769:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445883.996084:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742043136:0@lo:400:kworker.0 00000100:00100000:2.0:1789445883.996177:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445883.996244:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742043648:0@lo:400:kworker.0 00000100:00100000:2.0:1789445883.996273:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445883.996303:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789445883.996309:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742043520:0@lo:400:kworker.0 00000100:00100000:2.0:1789445883.996335:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445883.996396:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742043648 00000100:00100000:2.0:1789445883.996405:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742043648 00000100:00100000:2.0:1789445883.996479:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789445883.996491:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369742043648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445883.996549:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369742043648:12345-0@lo:400:kworker.0 Request processed in 61us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445883.996557:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789445883.996587:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742043520 00000100:00100000:2.0:1789445883.996591:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742043520 00000100:00100000:2.0:1789445883.996620:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789445883.996627:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742043520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445883.996657:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742043520:12345-0@lo:400:kworker.0 Request processed in 32us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445883.996664:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1789445883.996700:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789445883.996706:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445883.996741:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742043520:0@lo:400:kworker.0 00000100:00100000:2.0:1789445883.996752:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742043648:0@lo:400:kworker.0 00000100:00100000:0.0:1789445883.997163:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742043264:0@lo:400:kworker.0 00000100:00100000:0.0:1789445883.997203:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445883.997238:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742043776:0@lo:400:kworker.0 00000100:00100000:0.0:1789445883.997265:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445883.997295:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789445883.997302:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742043392:0@lo:400:kworker.0 00000100:00100000:0.0:1789445883.997336:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445883.997381:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742043776 00000100:00100000:0.0:1789445883.997386:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742043776 00000100:00100000:0.0:1789445883.997426:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789445883.997435:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742043776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445883.997477:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742043776:12345-0@lo:400:kworker.0 Request processed in 44us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445883.997484:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1789445883.997504:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789445883.997524:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742043776:0@lo:400:kworker.0 00000100:00100000:2.0:1789445883.997597:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742043264 00000100:00100000:2.0:1789445883.997602:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742043264 00000100:00100000:2.0:1789445883.997632:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742043392 00000100:00100000:2.0:1789445883.997635:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742043392 00000100:00100000:2.0:1789445883.997660:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789445883.997666:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742043264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445883.997716:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742043264:12345-0@lo:400:kworker.0 Request processed in 50us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445883.997723:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789445883.997736:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789445883.997741:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742043392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445883.997780:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742043392:12345-0@lo:400:kworker.0 Request processed in 39us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445883.997786:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789445883.997929:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742043136 00000100:00100000:1.0:1789445883.997934:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742043136 00000100:00100000:1.0:1789445883.997974:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789445883.997982:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742043136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445883.998037:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742043136:12345-0@lo:400:kworker.0 Request processed in 55us (1860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445883.998072:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:0.0:1789445883.998404:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789445883.998433:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742043392:0@lo:400:kworker.0 00000100:00100000:0.0:1789445883.998445:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742043264:0@lo:400:kworker.0 00000100:00100000:2.0:1789445883.998627:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742043136:0@lo:400:kworker.0 00000100:00100000:3.0:1789445884.506667:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789445884.506708:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebfbc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742043904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789445884.506794:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445884.506881:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742043904 00000100:00100000:3.0:1789445884.506890:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742043904 00000100:00100000:3.0:1789445884.506949:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789445884.506961:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742043904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789445884.507008:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789445884.507092:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742043904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445884.507099:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789445884.507165:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebfbc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742043904:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789445884.641502:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789445884.977021:0:12352:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 00:18:03 (1789445883) 00010000:00010000:3.0:1789445885.658499:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445886.023900:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445886.024214:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722112128 00000100:00100000:1.0:1789445886.024229:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722112128 00000100:00100000:1.0:1789445886.024333:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 136 00000100:00100000:1.0:1789445886.024368:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:11338:x1876369722112128:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00000100:00080000:0.0:1789445886.024380:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789445886.024403:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445886.024438:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d472569f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.024555:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a00 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.024587:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.024605:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.024624:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256a07 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.024633:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256a07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.024640:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256a07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.025141:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256a0e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.025153:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256a0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.025176:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256a0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445886.025189:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789445886.025383:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.025392:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a00 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.025399:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a00 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.025406:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6f800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445886.025412:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a00 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.025420:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a00 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.025435:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9afe90eacc00) 00010000:00010000:1.0:1789445886.025439:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445886.025445:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a00 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.025451:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a00 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.025466:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256a07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.025473:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256a07 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.025486:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256a07 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.025492:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6fe00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445886.025495:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256a07 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.025502:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256a07 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.025512:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9afe858f5100) 00010000:00010000:1.0:1789445886.025514:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445886.025518:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256a07 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.025524:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256a07 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.026247:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d472569f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d05 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.026279:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256a0e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d05 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445886.026288:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afe858f5c00) 00010000:00010000:1.0:1789445886.026290:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445886.026294:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6ee00, rc 0) 00000100:00100000:1.0:1789445886.026418:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:11338:x1876369722112128:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 2073us (2532us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789445886.026441:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 136 00000100:00100000:1.0:1789445886.031711:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445886.031912:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722112256 00000100:00100000:3.0:1789445886.031926:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722112256 00000100:00100000:3.0:1789445886.032000:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 137 00000100:00100000:3.0:1789445886.032011:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:11338:x1876369722112256:12345-192.168.206.59@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789445886.032196:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:11338:x1876369722112256:12345-192.168.206.59@tcp:59:lhsmtool_posix.0 Request processed in 187us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445886.032225:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 137 00000100:00100000:0.0:1789445886.032961:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445886.033775:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722112384 00000100:00100000:3.0:1789445886.038013:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722112384 00000100:00100000:3.0:1789445886.039338:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00100000:3.0:1789445886.039378:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:2377:x1876369722112384:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445886.039404:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445886.039443:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256a0e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d05 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445886.039470:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afe858f5c00) 00010000:00010000:3.0:1789445886.039477:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445886.039560:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:2377:x1876369722112384:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 206us (6602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445886.039568:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 9 00000040:00080000:0.0:1789445886.302808:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789445886.302822:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789445886.303596:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789445886.303612:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789445886.682216:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445887.066755:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5c79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742044032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789445887.066862:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445887.067076:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742044032 00000100:00100000:1.0:1789445887.067089:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742044032 00000100:00100000:1.0:1789445887.067184:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789445887.067198:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742044032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789445887.067247:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445887.067301:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742044032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445887.067308:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1789445887.067342:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445887.067481:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5c79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742044032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789445887.528865:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445887.528981:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445887.529067:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445887.529116:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445887.529152:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445887.530338:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722112896 00000100:00100000:3.0:1789445887.530371:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722112896 00000100:00100000:3.0:1789445887.530472:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722112768 00000100:00100000:3.0:1789445887.530477:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722112768 00000100:00100000:3.0:1789445887.530514:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 83 00000100:00100000:3.0:1789445887.530528:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2374:x1876369722112896:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445887.530634:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2374:x1876369722112896:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 109us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445887.530665:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 83 00000100:00100000:3.0:1789445887.530689:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 84 00000100:00100000:3.0:1789445887.530695:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2374:x1876369722112768:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445887.530726:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2374:x1876369722112768:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 31us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445887.530737:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 84 00000100:00080000:3.0:1789445887.530765:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789445887.530773:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789445887.538704:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722112512 00000100:00100000:0.0:1789445887.538724:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722112512 00000100:00100000:0.0:1789445887.538810:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 291 00000100:00100000:0.0:1789445887.538833:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2374:x1876369722112512:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445887.538963:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2374:x1876369722112512:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 133us (9920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445887.538970:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 291 00000100:00100000:2.0:1789445887.544188:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722112640 00000100:00100000:2.0:1789445887.544216:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722112640 00000100:00100000:2.0:1789445887.544365:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722113024 00000100:00100000:2.0:1789445887.544370:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722113024 00000100:00100000:2.0:1789445887.544445:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 143 00000100:00100000:2.0:1789445887.544487:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:2374:x1876369722112640:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445887.544633:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:2374:x1876369722112640:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 150us (15791us total) trans 0 rc 0/0 00000100:00080000:1.0:1789445887.544741:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445887.544784:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 143 00000100:00100000:2.0:1789445887.544817:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 144 00000100:00100000:2.0:1789445887.544826:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2374:x1876369722113024:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445887.544865:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2374:x1876369722113024:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 40us (15712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445887.544871:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 144 00010000:00010000:1.0:1789445887.706474:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445888.225079:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445888.225194:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722113152 00000100:00100000:2.0:1789445888.225211:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722113152 00000100:00100000:2.0:1789445888.225372:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 138 00000100:00100000:2.0:1789445888.225389:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:11380:x1876369722113152:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:2.0:1789445888.225425:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445888.225461:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256a1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d0c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.225576:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256a23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.225595:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256a23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.225610:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256a23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.225628:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256a2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.225650:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256a2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.225658:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256a2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.225918:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256a23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.225928:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256a23 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.225937:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256a23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.225944:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445888.225950:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256a23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.225959:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256a23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.225974:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe8e97a500) 00010000:00010000:2.0:1789445888.225977:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445888.225984:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256a23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.225991:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256a23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.226001:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256a2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.226014:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256a2a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.226019:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256a2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.226024:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bfc00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445888.226027:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256a2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.226034:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256a2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.226084:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9afe90eac800) 00010000:00010000:2.0:1789445888.226088:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445888.226091:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256a2a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.226097:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256a2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.226139:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256a1c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d0c expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.226151:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe8e97a500) 00010000:00010000:2.0:1789445888.226153:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445888.226157:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256a1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d0c expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.226809:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf000, rc 0) 00000100:00100000:2.0:1789445888.226924:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:11380:x1876369722113152:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 1538us (1893us total) trans 0 rc 301/301 00000100:00100000:2.0:1789445888.226936:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 138 00000100:00080000:3.0:1789445888.231928:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789445888.236008:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:1.0:1789445888.245445:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445888.245508:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722113408 00000100:00100000:1.0:1789445888.245522:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722113408 00000100:00100000:1.0:1789445888.245604:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 139 00000100:00100000:1.0:1789445888.245618:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:11380:x1876369722113408:12345-192.168.206.59@tcp:36:lfs.0 00010000:00010000:1.0:1789445888.246129:0:8204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445888.246178:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d472563a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b4c expref: 13 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.247454:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe8e97a500) 00010000:00010000:1.0:1789445888.247477:0:8204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789445888.247845:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256a31 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.247867:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256a31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.247891:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256a31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.247908:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256a38 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.247917:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256a38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.247924:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256a38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445888.249844:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789445888.249874:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256a31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.249888:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256a31 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.249896:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256a31 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.249903:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445888.249909:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256a31 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.249920:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256a31 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.249941:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe858f5900) 00010000:00010000:1.0:1789445888.249945:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445888.249960:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256a31 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.249967:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256a31 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789445888.249996:0:8204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ead89c4 reply state 00000000487d1d41 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256a38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445888.250007:0:8204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789445888.250458:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:11380:x1876369722113408:12345-192.168.206.59@tcp:36:lfs.0 Request processed in 4837us (5018us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789445888.250470:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 139 00010000:00010000:3.0:1789445888.271451:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256a38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.271475:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256a38 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.271484:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256a38 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.271491:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6ec00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445888.271497:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256a38 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.271505:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256a38 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.271527:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9afe858f5700) 00010000:00010000:3.0:1789445888.271546:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445888.271553:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256a38 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.271561:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256a38 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789445888.346696:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789445888.346712:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789445888.347657:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1789445888.347673:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789445888.396718:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445888.396843:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722113536 00000100:00100000:0.0:1789445888.396861:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722113536 00000100:00100000:0.0:1789445888.396971:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 140 00000100:00100000:0.0:1789445888.396984:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:11388:x1876369722113536:12345-192.168.206.59@tcp:101:lctl.0 00010000:00010000:0.0:1789445888.397021:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445888.397094:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256a3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d13 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.397200:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256a46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.397222:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256a46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.397238:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256a46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445888.397301:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789445888.397306:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789445888.397357:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256a46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.397433:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256a3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d13 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.397460:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256a46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d13 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.397471:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961000) 00010000:00010000:0.0:1789445888.397475:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789445888.397480:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907a00, rc 0) 00000100:00100000:0.0:1789445888.397571:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:11388:x1876369722113536:12345-192.168.206.59@tcp:101:lctl.0 Request processed in 590us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445888.397579:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 140 00000100:00100000:0.0:1789445888.503102:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445888.503307:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722113664 00000100:00100000:1.0:1789445888.503321:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722113664 00000100:00100000:1.0:1789445888.503407:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 141 00000100:00100000:1.0:1789445888.503420:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+14:11394:x1876369722113664:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:1.0:1789445888.503448:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445888.503477:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256a4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d1a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503560:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256a54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503588:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256a54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503602:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256a54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503631:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256a5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503639:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256a5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503646:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256a5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503769:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256a62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503780:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503789:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445888.503822:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789445888.503827:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789445888.503852:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503868:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256a54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503880:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256a54 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503895:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256a54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503917:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6f200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445888.503923:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256a54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503933:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256a54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503949:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961000) 00010000:00010000:1.0:1789445888.503953:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445888.503960:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256a54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503966:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256a54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503980:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256a5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503987:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256a5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503993:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256a5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.503998:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6fa00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445888.504002:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256a5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.504009:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256a5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.504030:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9afe858f5900) 00010000:00010000:1.0:1789445888.504033:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445888.504037:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256a5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.504073:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256a5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.504115:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256a4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d1a expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.504131:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256a62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d1a expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.504138:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:1.0:1789445888.504140:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789445888.504143:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6e800, rc 0) 00000100:00100000:1.0:1789445888.504225:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:11394:x1876369722113664:12345-192.168.206.59@tcp:101:bash.0 Request processed in 808us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445888.504234:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 141 00000100:00100000:3.0:1789445888.507787:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445888.508248:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722113920 00000100:00100000:0.0:1789445888.508262:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722113920 00000100:00100000:0.0:1789445888.508358:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 142 00000100:00100000:0.0:1789445888.508376:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+15:11394:x1876369722113920:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:0.0:1789445888.508408:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445888.508442:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256a69 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d21 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.508650:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256a70 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.508675:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256a70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.508720:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256a70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.508958:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256a77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.508983:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256a77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.508998:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256a77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789445888.509949:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789445888.510300:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.510321:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.510335:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.510411:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256a70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.510419:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256a70 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.510426:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256a70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.510434:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445888.510439:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256a70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.510447:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256a70 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.510460:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:1.0:1789445888.510464:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445888.510469:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256a70 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.510476:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256a70 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789445888.510493:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2b69473 reply state 00000000a496a635 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256a77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445888.510513:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789445888.510559:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256a69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d21 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.510589:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d21 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.510597:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe858f5a00) 00010000:00010000:1.0:1789445888.510600:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789445888.510603:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6f800, rc 0) 00000100:00100000:1.0:1789445888.510709:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:11394:x1876369722113920:12345-192.168.206.59@tcp:101:bash.0 Request processed in 2340us (2938us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1789445888.510719:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 142 00010000:00010000:0.0:1789445888.517129:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256a77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.517153:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256a77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.517163:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256a77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.517170:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445888.517176:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256a77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.517185:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256a77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.517206:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe98961c00) 00010000:00010000:0.0:1789445888.517210:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445888.517241:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256a77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.517248:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256a77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445888.517545:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445888.518020:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722114048 00000100:00100000:3.0:1789445888.518034:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722114048 00000100:00100000:3.0:1789445888.518140:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 47 00000100:00100000:3.0:1789445888.518169:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2374:x1876369722114048:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:3.0:1789445888.518193:0:11692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445888.518219:0:11692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a69ee5c/0xc1b37c4d47256a8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d28 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789445888.518837:0:11692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789445888.518870:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=326s v=(0 0) 00010000:00010000:3.0:1789445888.518875:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445888.518888:0:11692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a69ee5c/0xc1b37c4d47256a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d28 expref: 6 pid: 11692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.518911:0:11692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a69ee5c/0xc1b37c4d47256a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d28 expref: 6 pid: 11692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.518926:0:11692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fd200, rc 0) 00000100:00100000:3.0:1789445888.519013:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2374:x1876369722114048:12345-192.168.206.59@tcp:101:bash.0 Request processed in 861us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445888.519039:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 47 00000100:00100000:0.0:1789445888.523135:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445888.523372:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722114176 00000100:00100000:2.0:1789445888.523386:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722114176 00000100:00100000:2.0:1789445888.523462:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 48 00000100:00100000:2.0:1789445888.523474:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:11394:x1876369722114176:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:2.0:1789445888.523499:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445888.523527:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d47256a93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d2f expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.523570:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a69ee5c/0xc1b37c4d47256a8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d28 expref: 7 pid: 11692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.523580:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445888.523585:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445888.523603:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d47256a93 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d2f expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.523646:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a69ee5c/0xc1b37c4d47256a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d28 expref: 7 pid: 11692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.523664:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a69ee5c/0xc1b37c4d47256a8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d28 expref: 7 pid: 11692 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445888.523681:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5370380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876369742044160:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445888.523918:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87d5bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789445888.527880:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445888.528308:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5370380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876369742044160:192.168.206.59@tcp:104: 00010000:00010000:2.0:1789445888.528358:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d47256a93 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d2f expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.528394:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf000, rc 0) 00000100:00100000:2.0:1789445888.528470:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:11394:x1876369722114176:12345-192.168.206.59@tcp:101:bash.0 Request processed in 4997us (5349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445888.528480:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 48 00000100:00100000:3.0:1789445888.528718:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722114304 00000100:00100000:3.0:1789445888.528729:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722114304 00010000:00010000:3.0:1789445888.528773:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a69ee5c/0xc1b37c4d47256a8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d28 expref: 7 pid: 11692 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445888.528813:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 62 00000100:00100000:3.0:1789445888.528823:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2375:x1876369722114304:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445888.528839:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445888.528872:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a69ee5c/0xc1b37c4d47256a8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d28 expref: 7 pid: 11692 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.529645:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a69ee5c/0xc1b37c4d47256a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d28 expref: 7 pid: 11692 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.529749:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a69ee5c/0xc1b37c4d47256a8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d28 expref: 7 pid: 11692 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.529771:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445888.529777:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445888.529787:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d47256a93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d2f expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.529800:0:7627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d47256a93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d2f expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.529879:0:7627:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d47256a93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d2f expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445888.529899:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebfbc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7627:1876369742044288:192.168.206.59@tcp:105: 00000100:00100000:2.0:1789445888.530094:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe85da73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445888.538203:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445888.538329:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebfbc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7627:1876369742044288:192.168.206.59@tcp:105: 00010000:00010000:2.0:1789445888.538370:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445888.538663:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2375:x1876369722114304:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 9839us (10797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445888.538677:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 62 00000100:00100000:1.0:1789445888.538901:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722114560 00000100:00100000:1.0:1789445888.538912:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722114560 00000100:00100000:1.0:1789445888.538976:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 36 00000100:00100000:1.0:1789445888.538987:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+17:11394:x1876369722114560:12345-192.168.206.59@tcp:35:bash.0 00000100:00100000:1.0:1789445888.542086:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:11394:x1876369722114560:12345-192.168.206.59@tcp:35:bash.0 Request processed in 3087us (3883us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789445888.542101:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 36 00000100:00100000:0.0:1789445888.625852:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445888.625963:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722114816 00000100:00100000:1.0:1789445888.625976:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722114816 00000100:00100000:1.0:1789445888.626129:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 143 00000100:00100000:1.0:1789445888.626142:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:11404:x1876369722114816:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:1.0:1789445888.626194:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445888.626221:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256a9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d36 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445888.626397:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789445888.626572:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256a9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d36 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.626590:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961000) 00010000:00010000:1.0:1789445888.626594:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789445888.626601:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256a9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d36 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.626617:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6fa00, rc 0) 00000100:00100000:1.0:1789445888.626706:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:11404:x1876369722114816:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 567us (868us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1789445888.626715:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 143 00000100:00100000:0.0:1789445888.632773:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445888.633281:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722115072 00000100:00100000:3.0:1789445888.633294:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722115072 00000100:00100000:3.0:1789445888.633385:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 37 00000100:00100000:3.0:1789445888.633398:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:11404:x1876369722115072:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:3.0:1789445888.634822:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:11404:x1876369722115072:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 1415us (2054us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789445888.634850:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 37 00000100:00100000:2.0:1789445888.729183:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445888.729371:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722115200 00000100:00100000:3.0:1789445888.729385:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722115200 00000100:00100000:3.0:1789445888.729455:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 144 00000100:00100000:3.0:1789445888.729467:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:11410:x1876369722115200:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445888.729499:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445888.729524:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256aa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d3d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.729613:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256aaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.729629:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256aaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.729665:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256aaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445888.729708:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789445888.729712:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789445888.729730:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256aaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.729761:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256aa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d3d expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.729783:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256aaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d3d expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.729791:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:3.0:1789445888.729793:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789445888.729798:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fc000, rc 0) 00000100:00100000:3.0:1789445888.729877:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:11410:x1876369722115200:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 411us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445888.729885:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 144 00010000:00010000:3.0:1789445888.730836:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445888.732785:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445888.739032:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722115456 00000100:00100000:1.0:1789445888.739082:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722115456 00000100:00100000:1.0:1789445888.739212:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 145 00000100:00100000:1.0:1789445888.739244:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:11410:x1876369722115456:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:1.0:1789445888.739281:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445888.739314:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256ab6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d44 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.739487:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256abd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.739507:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256abd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.739550:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256abd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445888.739567:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789445888.739792:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256ab6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d44 expref: 24 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.739820:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256abd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d44 expref: 23 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.739829:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe858f5a00) 00010000:00010000:1.0:1789445888.739833:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789445888.739838:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6f200, rc 0) 00000100:00100000:1.0:1789445888.739949:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:11410:x1876369722115456:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 724us (7177us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1789445888.739957:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 145 00000100:00100000:0.0:1789445888.755616:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445888.755895:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722115712 00000100:00100000:3.0:1789445888.755912:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722115712 00000100:00100000:3.0:1789445888.756008:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 146 00000100:00100000:3.0:1789445888.756023:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:11410:x1876369722115712:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445888.756121:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445888.756511:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256acb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d4b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445888.761433:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445888.761592:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722115840 00000100:00100000:3.0:1789445888.761609:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722115840 00000100:00100000:3.0:1789445888.761724:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:3.0:1789445888.761741:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+25:2377:x1876369722115840:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445888.761766:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445888.761810:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256abd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d44 expref: 25 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.761855:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe858f5a00) 00010000:00010000:3.0:1789445888.761864:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445888.761958:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:2377:x1876369722115840:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 221us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445888.761968:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 10 00010000:00010000:2.0:1789445888.765179:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256ad2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.765215:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.765232:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445888.767311:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789445888.767596:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256acb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d4b expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.767648:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256ad2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d4b expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.767659:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe858f5a00) 00010000:00010000:2.0:1789445888.767663:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789445888.767667:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf400, rc 0) 00000100:00100000:2.0:1789445888.767796:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:11410:x1876369722115712:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 11775us (12196us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789445888.767808:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 146 00000100:00100000:0.0:1789445888.783439:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445888.783624:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722115968 00000100:00100000:1.0:1789445888.783649:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722115968 00000100:00100000:1.0:1789445888.783732:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 49 00000100:00100000:1.0:1789445888.783747:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2374:x1876369722115968:12345-192.168.206.59@tcp:1:lfs.0 00010000:00010000:1.0:1789445888.783828:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000222ff3ea/0xc1b37c4d47256ae0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.783869:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d47256a93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d2f expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.783880:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445888.783906:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789445888.783912:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000222ff3ea/0xc1b37c4d47256ae0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.783970:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d47256a93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d2f expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.783988:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d47256a93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d2f expref: 6 pid: 6684 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445888.784009:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba73ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1876369742044416:192.168.206.59@tcp:104: 00000100:00100000:1.0:1789445888.784953:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afd82cb46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445888.803650:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445888.803884:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722116096 00000100:00100000:3.0:1789445888.803902:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722116096 00002000:00100000:3.0:1789445888.803987:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9afebf5b9500 x1876369722116096/t0(0) o4->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:14/0 lens 504/0 e 0 to 0 dl 1789445899 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789445888.804151:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afebf5b9500 with x1876369722116096 ext(0->12) 00010000:00010000:3.0:1789445888.804224:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d47256a93 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d2f expref: 7 pid: 6684 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.804248:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d47256a93 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d2f expref: 7 pid: 6684 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789445888.804257:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9afebf5b9500 00000100:00100000:3.0:1789445888.804320:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 2 00000100:00100000:3.0:1789445888.804331:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2375:x1876369722116096:12345-192.168.206.59@tcp:4:lfs.0 00000100:00100000:1.0:1789445888.805356:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba73ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1876369742044416:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789445888.805391:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000222ff3ea/0xc1b37c4d47256ae0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445888.823536:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:2375:x1876369722116096:12345-192.168.206.59@tcp:4:lfs.0 Request processed in 19187us (19886us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789445888.823557:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 2 00002000:00100000:0.0:1789445888.823576:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9afebf5b9500 x1876369722116096/t4294967305(0) o4->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:14/0 lens 504/448 e 0 to 0 dl 1789445899 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789445888.823588:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afebf5b9500 with x1876369722116096 ext(0->12) 00010000:00010000:0.0:1789445888.823602:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d47256a93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d2f expref: 9 pid: 6684 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.823633:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d47256a93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d2f expref: 9 pid: 6684 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789445888.823663:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9afebf5b9500 00000100:00100000:2.0:1789445888.837574:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445888.841837:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722116224 00000100:00100000:1.0:1789445888.841869:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722116224 00010000:00010000:1.0:1789445888.841959:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d47256a93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d2f expref: 9 pid: 6684 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445888.842037:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 63 00000100:00100000:1.0:1789445888.842112:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5373800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:2374:x1876369722116224:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789445888.842141:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789445888.842182:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789445888.842186:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789445888 00002000:00010000:1.0:1789445888.842212:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789445888 00002000:00010000:1.0:1789445888.842214:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789445888 00010000:00010000:1.0:1789445888.842224:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d47256a93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d2f expref: 9 pid: 6684 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.842243:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d47256a93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d2f expref: 9 pid: 6684 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.842276:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032d4276d/0xc1b37c4d47256a93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d2f expref: 9 pid: 6684 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.842298:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789445888.842303:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789445888.842311:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000222ff3ea/0xc1b37c4d47256ae0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.842322:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000222ff3ea/0xc1b37c4d47256ae0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.842366:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445888.842468:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5373800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2374:x1876369722116224:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 361us (4917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445888.842476:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 63 00010000:00010000:0.0:1789445888.842714:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000222ff3ea/0xc1b37c4d47256ae0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.842726:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000222ff3ea/0xc1b37c4d47256ae0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.842760:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000222ff3ea/0xc1b37c4d47256ae0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.842768:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000222ff3ea/0xc1b37c4d47256ae0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.842776:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000222ff3ea/0xc1b37c4d47256ae0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.842784:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e000 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445888.842790:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000222ff3ea/0xc1b37c4d47256ae0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.842800:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000222ff3ea/0xc1b37c4d47256ae0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.842816:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000222ff3ea/0xc1b37c4d47256ae0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.842840:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000222ff3ea/0xc1b37c4d47256ae0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445888.842906:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2374:x1876369722115968:12345-192.168.206.59@tcp:1:lfs.0 Request processed in 59164us (59487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445888.842915:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 49 00000100:00100000:1.0:1789445888.852980:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445888.853172:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722116480 00000100:00100000:0.0:1789445888.853191:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722116480 00000100:00100000:0.0:1789445888.853280:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 38 00000100:00100000:0.0:1789445888.853295:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c00050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:11410:x1876369722116480:12345-192.168.206.59@tcp:35:lfs.0 00000004:00010000:0.0:1789445888.853428:0:11955:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256ad2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d4b expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789445888.853877:0:11955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1789445888.853924:0:11955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1789445888.854627:0:11955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1789445888.854723:0:11955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256ae7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.854750:0:11955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d21 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.854763:0:11955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256ae7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.854819:0:11955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d21 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445888.854860:0:11955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d21 expref: 28 pid: 5841 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445888.854883:0:11955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf5b8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11955:1876369742044544:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445888.855090:0:11955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb56f5480 going to sleep for 11 seconds 00000100:00100000:0.0:1789445888.859872:0:11955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf5b8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11955:1876369742044544:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789445888.859925:0:11955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256ae7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445888.861232:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445888.862144:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722116608 00000100:00100000:3.0:1789445888.862179:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722116608 00010000:00010000:3.0:1789445888.862255:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d21 expref: 29 pid: 5841 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445888.862328:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 64 00000100:00100000:3.0:1789445888.862340:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+29:2374:x1876369722116608:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445888.862370:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445888.862379:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d21 expref: 29 pid: 5841 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.862398:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d21 expref: 29 pid: 5841 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.862436:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256a7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d21 expref: 29 pid: 5841 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.862466:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe858f5a00) 00010000:00010000:3.0:1789445888.862473:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256ae7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.862486:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256ae7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.862497:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256ae7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445888.862591:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789445888.862806:0:11955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256ae7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.862829:0:11955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256ae7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789445888.863033:0:11955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789445888.863343:0:11955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1789445888.863515:0:11955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba73dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11955:1876369742044672:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789445888.863593:0:11955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445888.863641:0:11955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afd82cb4600 going to sleep for 11 seconds 00000100:00100000:1.0:1789445888.863672:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742044672 00000100:00100000:1.0:1789445888.863680:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742044672 00000100:00100000:1.0:1789445888.863733:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789445888.863742:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11955:x1876369742044672:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789445888.863824:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11955:x1876369742044672:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 83us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445888.863832:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789445888.863885:0:11955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba73dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11955:1876369742044672:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1789445888.864562:0:11955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1789445888.864639:0:11955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba73dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11955:1876369742044800:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789445888.864682:0:11955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445888.864729:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742044800 00000100:00100000:1.0:1789445888.864736:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742044800 00000100:00100000:1.0:1789445888.864772:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789445888.864781:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11955:x1876369742044800:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789445888.864958:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11955:x1876369742044800:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 177us (273us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789445888.864977:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789445888.865001:0:11955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afd82cb46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445888.865028:0:11955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba73dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11955:1876369742044800:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1789445888.865130:0:11955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1789445888.865172:0:11955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256ae7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.865183:0:11955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256ae7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.865192:0:11955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256ae7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.865199:0:11955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445888.865204:0:11955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256ae7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.865213:0:11955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256ae7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.865232:0:11955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe858f5a00) 00010000:00010000:1.0:1789445888.865236:0:11955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789445888.865242:0:11955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256ae7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445888.865249:0:11955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256ae7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789445888.865475:0:11955:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789445888.865617:0:11955:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000100:00100000:3.0:1789445888.867435:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+32:2374:x1876369722116608:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 5072us (6191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445888.867459:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 64 00000004:00080000:2.0:1789445888.878817:0:11955:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 326900766191ns, next at 327900752096ns, rc = 0 00000001:00080000:2.0:1789445888.878854:0:11955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789445888.878991:0:11955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe858f5a00) 00010000:00010000:2.0:1789445888.880126:0:11955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789445888.880148:0:11955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256ad2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d4b expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445888.884583:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c00050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+31:11410:x1876369722116480:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 31268us (31596us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1789445888.884608:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 38 00000020:00080000:2.0:1789445888.884624:0:11955:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789445888.898020:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445888.899559:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722116736 00000100:00100000:1.0:1789445888.899581:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722116736 00000100:00100000:2.0:1789445888.899791:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 147 00000100:00100000:2.0:1789445888.899809:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+31:11410:x1876369722116736:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:2.0:1789445888.899845:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445888.899882:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256aee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d52 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.899993:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256aee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d52 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.900014:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256aee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d52 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445888.900041:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:2.0:1789445888.900117:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789445888.900122:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf600, rc 0) 00000100:00100000:2.0:1789445888.900241:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+32:11410:x1876369722116736:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 437us (2234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445888.900249:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 147 00000100:00100000:3.0:1789445888.904900:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445888.905099:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722116992 00000100:00100000:0.0:1789445888.905114:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722116992 00000100:00100000:0.0:1789445888.905205:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 39 00000100:00100000:0.0:1789445888.905220:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+32:11410:x1876369722116992:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:0.0:1789445888.905600:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+33:11410:x1876369722116992:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 382us (716us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1789445888.905610:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 39 00000100:00100000:3.0:1789445889.013769:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445889.013948:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722117248 00000100:00100000:1.0:1789445889.013961:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722117248 00000100:00100000:1.0:1789445889.014092:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 148 00000100:00100000:1.0:1789445889.014106:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+33:11420:x1876369722117248:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:1.0:1789445889.014144:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445889.014189:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256af5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d59 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445889.014315:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789445889.014513:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256af5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d59 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445889.014532:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961000) 00010000:00010000:1.0:1789445889.014536:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789445889.014543:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256af5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d59 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445889.014565:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6fe00, rc 0) 00000100:00100000:1.0:1789445889.014649:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+34:11420:x1876369722117248:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 547us (895us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1789445889.014657:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 148 00000100:00100000:1.0:1789445889.030845:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445889.031101:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722117376 00000100:00100000:2.0:1789445889.031117:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722117376 00000100:00100000:2.0:1789445889.031219:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 149 00000100:00100000:2.0:1789445889.031233:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+34:11420:x1876369722117376:12345-192.168.206.59@tcp:34:lfs.0 00010000:00010000:2.0:1789445889.031391:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.031425:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.031447:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.031469:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.031502:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.031509:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.031652:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.031662:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.031669:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789445889.031730:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.031746:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.031754:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.031762:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.031769:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445889.031774:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.031784:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.031811:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:2.0:1789445889.031815:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445889.032301:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.032323:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.032344:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.032359:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.032366:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.032372:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bee00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445889.032375:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.032382:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.032393:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe90eac600) 00010000:00010000:2.0:1789445889.032396:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445889.032400:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.032405:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.032439:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.032447:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.032453:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.032459:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445889.032463:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.032469:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.032478:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:2.0:1789445889.032481:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445889.032484:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.032490:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445889.032612:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+34:11420:x1876369722117376:12345-192.168.206.59@tcp:34:lfs.0 Request processed in 1377us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445889.032623:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 149 00000100:00100000:0.0:1789445889.035838:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445889.036782:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722117632 00000100:00100000:2.0:1789445889.036798:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722117632 00000100:00100000:2.0:1789445889.036877:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 40 00000100:00100000:2.0:1789445889.036909:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+34:11420:x1876369722117632:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:2.0:1789445889.037694:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+35:11420:x1876369722117632:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 783us (1879us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789445889.037706:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 40 00000100:00100000:2.0:1789445889.114562:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369742045184:0@lo:400:kworker.0 00000100:00100000:2.0:1789445889.114672:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445889.114772:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789445889.114779:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876369742045056:0@lo:400:kworker.0 00000100:00100000:2.0:1789445889.114805:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445889.114839:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742045568:0@lo:400:kworker.0 00000100:00100000:2.0:1789445889.114869:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445889.114912:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742045184 00000100:00100000:2.0:1789445889.114924:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742045184 00000100:00100000:2.0:1789445889.114989:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742045056 00000100:00100000:2.0:1789445889.114992:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742045056 00000100:00100000:2.0:1789445889.115022:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789445889.115034:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369742045184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445889.115141:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369742045184:12345-0@lo:400:kworker.0 Request processed in 109us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445889.115150:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789445889.115190:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789445889.115197:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876369742045056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445889.115224:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876369742045056:12345-0@lo:400:kworker.0 Request processed in 28us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445889.115231:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789445889.115306:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876369742045056:0@lo:400:kworker.0 00000100:00100000:2.0:1789445889.115320:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369742045184:0@lo:400:kworker.0 00000100:00100000:0.0:1789445889.115645:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742044928:0@lo:400:kworker.0 00000100:00100000:0.0:1789445889.115707:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445889.115755:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742045440:0@lo:400:kworker.0 00000100:00100000:0.0:1789445889.115781:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445889.115804:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789445889.115811:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5372a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742045312:0@lo:400:kworker.0 00000100:00100000:0.0:1789445889.115860:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445889.115889:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742045440 00000100:00100000:0.0:1789445889.115894:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742045440 00000100:00100000:0.0:1789445889.115935:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789445889.115943:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369742045440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445889.115986:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876369742045440:12345-0@lo:400:kworker.0 Request processed in 44us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445889.115993:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789445889.116024:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742045440:0@lo:400:kworker.0 00000100:00100000:1.0:1789445889.116342:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742045568 00000100:00100000:1.0:1789445889.116358:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742045568 00000100:00100000:1.0:1789445889.116402:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742045312 00000100:00100000:1.0:1789445889.116406:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742045312 00000100:00100000:1.0:1789445889.116430:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789445889.116449:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742045568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445889.116508:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742045568:12345-0@lo:400:kworker.0 Request processed in 62us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445889.116514:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789445889.116529:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789445889.116535:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1876369742045312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445889.116570:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1876369742045312:12345-0@lo:400:kworker.0 Request processed in 35us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445889.116576:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789445889.116612:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5372a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742045312:0@lo:400:kworker.0 00000100:00100000:1.0:1789445889.116639:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742045568:0@lo:400:kworker.0 00000100:00100000:2.0:1789445889.116793:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742044928 00000100:00100000:2.0:1789445889.116799:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742044928 00000100:00100000:2.0:1789445889.116845:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789445889.116855:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742044928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445889.116897:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742044928:12345-0@lo:400:kworker.0 Request processed in 45us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445889.116904:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789445889.117326:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742044928:0@lo:400:kworker.0 00000100:00080000:3.0:1789445889.117972:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789445889.117979:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789445889.117983:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789445889.118359:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445889.118441:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722117888 00000100:00100000:0.0:1789445889.118452:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722117888 00000100:00100000:0.0:1789445889.118518:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 150 00000100:00100000:0.0:1789445889.118529:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+35:11423:x1876369722117888:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:0.0:1789445889.118566:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445889.118603:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256b18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d60 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.119555:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d47256b1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.119580:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d47256b1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.119597:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d47256b1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.119616:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.119650:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.119658:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.123767:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.123800:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.123817:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445889.123849:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789445889.124015:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d47256b1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.124024:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d47256b1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.124032:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d47256b1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.124038:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445889.124066:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d47256b1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.124075:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d47256b1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.124116:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:0.0:1789445889.124119:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445889.124126:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d47256b1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.124132:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907400/0xc1b37c4d47256b1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.124153:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.124160:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.124320:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.124328:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445889.124332:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.124339:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.124360:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe98961c00) 00010000:00010000:0.0:1789445889.124363:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445889.124366:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.124373:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.124473:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256b18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d60 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.124493:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d60 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.124503:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:0.0:1789445889.124505:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789445889.124509:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907000, rc 0) 00000100:00100000:0.0:1789445889.124641:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+37:11423:x1876369722117888:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 6112us (6295us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1789445889.124652:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 150 00000100:00100000:0.0:1789445889.130623:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445889.131088:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722118016 00000100:00100000:2.0:1789445889.131108:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722118016 00000100:00100000:2.0:1789445889.131309:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 151 00000100:00100000:2.0:1789445889.131323:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+37:11423:x1876369722118016:12345-192.168.206.59@tcp:54:lfs.0 00010000:00010000:2.0:1789445889.131434:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.131458:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.131475:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.131512:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.131520:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.131528:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.131555:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445889.131562:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.131571:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.131587:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:2.0:1789445889.131591:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789445889.131598:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.131605:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445889.131961:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+37:11423:x1876369722118016:12345-192.168.206.59@tcp:54:lfs.0 Request processed in 640us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445889.131970:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 151 00000100:00100000:1.0:1789445889.142580:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445889.142675:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722118272 00000100:00100000:2.0:1789445889.142691:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722118272 00000100:00100000:2.0:1789445889.142770:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 41 00000100:00100000:2.0:1789445889.142784:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+37:11423:x1876369722118272:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:2.0:1789445889.143219:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+38:11423:x1876369722118272:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 436us (653us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789445889.143227:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 41 00000100:00100000:1.0:1789445889.498201:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445889.498329:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722118528 00000100:00100000:2.0:1789445889.498350:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722118528 00000100:00100000:2.0:1789445889.498412:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 152 00000100:00100000:2.0:1789445889.498439:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+38:11454:x1876369722118528:12345-192.168.206.59@tcp:101:cat.0 00010000:00010000:2.0:1789445889.498473:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445889.498501:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d67 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.498647:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.498668:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.498696:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445889.498712:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789445889.498931:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d67 expref: 41 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.498956:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d67 expref: 40 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.498966:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:2.0:1789445889.498970:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789445889.498974:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bee00, rc 0) 00000100:00100000:2.0:1789445889.499110:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+40:11454:x1876369722118528:12345-192.168.206.59@tcp:101:cat.0 Request processed in 672us (925us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789445889.499118:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 152 00000100:00100000:3.0:1789445889.504254:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445889.504733:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722118784 00000100:00100000:2.0:1789445889.504747:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722118784 00000100:00100000:2.0:1789445889.504843:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 42 00000100:00100000:2.0:1789445889.504856:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+40:11454:x1876369722118784:12345-192.168.206.59@tcp:35:cat.0 00000100:00100000:2.0:1789445889.513833:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+41:11454:x1876369722118784:12345-192.168.206.59@tcp:35:cat.0 Request processed in 8962us (9577us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789445889.513854:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 42 00000100:00100000:1.0:1789445889.513955:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445889.514070:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722118912 00000100:00100000:2.0:1789445889.514083:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722118912 00000100:00100000:2.0:1789445889.514150:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00100000:2.0:1789445889.514161:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe87d87c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+41:2374:x1876369722118912:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445889.514179:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445889.514212:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d67 expref: 41 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.514236:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:2.0:1789445889.514243:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445889.514379:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe87d87c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+40:2374:x1876369722118912:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 219us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445889.514388:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00100000:1.0:1789445889.608718:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445889.608869:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722119168 00000100:00100000:0.0:1789445889.608882:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722119168 00000100:00100000:0.0:1789445889.608963:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 153 00000100:00100000:0.0:1789445889.608976:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+40:11460:x1876369722119168:12345-192.168.206.59@tcp:101:dd.0 00010000:00010000:0.0:1789445889.609012:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445889.609015:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789445889.609099:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256aaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d3d expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.609125:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:0.0:1789445889.609131:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789445889.609149:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256b57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d6e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.609297:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.609326:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d60 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.609337:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b5e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.609389:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d60 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.609405:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d60 expref: 40 pid: 5842 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445889.609421:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf5bbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742045696:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445889.609537:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb56f5480 going to sleep for 11 seconds 00000100:00100000:0.0:1789445889.614290:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf5bbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742045696:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789445889.614340:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445889.619791:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445889.621625:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722119296 00000100:00100000:0.0:1789445889.621644:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722119296 00010000:00010000:0.0:1789445889.621707:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d60 expref: 41 pid: 5842 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445889.621768:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 65 00000100:00100000:0.0:1789445889.621798:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+41:2375:x1876369722119296:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789445889.621818:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445889.621827:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d60 expref: 41 pid: 5842 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.621857:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d60 expref: 41 pid: 5842 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.621888:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d60 expref: 41 pid: 5842 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.621914:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:0.0:1789445889.621921:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.621932:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.621941:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b5e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.621987:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445889.622120:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+40:2375:x1876369722119296:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 324us (2351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445889.622129:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 65 00010000:00010000:2.0:1789445889.622881:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.622893:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445889.622922:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789445889.623189:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256b57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d6e expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.623236:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d6e expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.623244:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:2.0:1789445889.623248:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789445889.623251:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907e00, rc 0) 00000100:00100000:2.0:1789445889.623313:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+40:11460:x1876369722119168:12345-192.168.206.59@tcp:101:dd.0 Request processed in 14340us (14609us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789445889.623322:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 153 00000100:00100000:1.0:1789445889.626539:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebfbc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742045824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789445889.626645:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445889.626979:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742045824 00000100:00100000:3.0:1789445889.626990:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742045824 00000100:00100000:3.0:1789445889.627102:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789445889.627113:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742045824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789445889.627260:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789445889.627565:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742045824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 452us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445889.627574:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789445889.631387:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445889.631501:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722119552 00000100:00100000:0.0:1789445889.631517:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722119552 00000100:00100000:0.0:1789445889.631608:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 154 00000100:00100000:0.0:1789445889.631622:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+40:11460:x1876369722119552:12345-192.168.206.59@tcp:36:dd.0 00010000:00010000:0.0:1789445889.632217:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.632243:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.632256:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445889.633578:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebfbc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742045824:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789445889.639699:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1789445889.639816:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f453d4b2 reply state 00000000b8f0567f transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445889.639834:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789445889.640064:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+43:11460:x1876369722119552:12345-192.168.206.59@tcp:36:dd.0 Request processed in 8418us (8670us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789445889.640077:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 154 00000020:00080000:0.0:1789445889.640086:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789445889.651464:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445889.651488:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445889.651516:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445889.651523:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445889.651529:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445889.651538:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445889.651560:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:1.0:1789445889.651564:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445889.651570:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445889.651578:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256b6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445889.755074:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445889.926372:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445889.927009:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722119680 00000100:00100000:2.0:1789445889.927027:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722119680 00000100:00100000:2.0:1789445889.927149:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 155 00000100:00100000:2.0:1789445889.927164:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+42:11474:x1876369722119680:12345-192.168.206.59@tcp:101:stat.0 00010000:00010000:2.0:1789445889.927199:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445889.927228:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d75 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.927328:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b7a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.927353:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.927367:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.927421:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.927430:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.927437:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.927533:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256b88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.927545:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b5e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d6e expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.927554:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256b88 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.927590:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d6e expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.927603:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d6e expref: 43 pid: 5840 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445889.927618:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb5373800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742045952:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445889.928324:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87d5bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789445889.934849:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445889.935402:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb5373800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742045952:192.168.206.59@tcp:104: 00010000:00010000:2.0:1789445889.935458:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256b88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445889.938589:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722119936 00000100:00100000:0.0:1789445889.938614:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722119936 00000100:00100000:0.0:1789445889.938860:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 43 00000100:00100000:0.0:1789445889.938875:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+44:5629:x1876369722119936:12345-192.168.206.59@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789445889.940209:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+45:5629:x1876369722119936:12345-192.168.206.59@tcp:35:ldlm_bl.0 Request processed in 1325us (5367us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1789445889.940223:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 43 00000100:00100000:0.0:1789445889.943337:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445889.943461:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722120064 00000100:00100000:2.0:1789445889.943473:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722120064 00010000:00010000:2.0:1789445889.943526:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d6e expref: 45 pid: 5840 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445889.943576:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 66 00000100:00100000:2.0:1789445889.943585:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+45:2375:x1876369722120064:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445889.943605:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445889.943613:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d6e expref: 45 pid: 5840 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.943627:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d6e expref: 45 pid: 5840 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.943655:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907e00/0xc1b37c4d47256b5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d6e expref: 45 pid: 5840 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.943674:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:2.0:1789445889.943690:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256b88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.943702:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256b88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.943711:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256b88 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.943747:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445889.943834:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+44:2375:x1876369722120064:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 247us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445889.943842:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 66 00010000:00010000:0.0:1789445889.944248:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256b88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944269:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256b88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445889.944328:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789445889.944334:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789445889.944372:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256b88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944389:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256b88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944400:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944408:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b7a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944416:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944423:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445889.944427:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944437:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b7a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944448:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:0.0:1789445889.944451:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445889.944456:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944474:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256b7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944489:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944495:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944501:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944506:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445889.944509:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944515:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944522:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe90eac600) 00010000:00010000:0.0:1789445889.944525:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445889.944528:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944533:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256b81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944577:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d75 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944590:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256b88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d75 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.944603:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:0.0:1789445889.944606:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789445889.944608:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57be800, rc 0) 00000100:00100000:0.0:1789445889.944644:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+43:11474:x1876369722119680:12345-192.168.206.59@tcp:101:stat.0 Request processed in 17485us (18289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445889.944651:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 155 00000100:00100000:1.0:1789445889.988565:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445889.988708:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722120320 00000100:00100000:2.0:1789445889.988724:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722120320 00000100:00100000:2.0:1789445889.988868:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 156 00000100:00100000:2.0:1789445889.988882:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+43:11480:x1876369722120320:12345-192.168.206.59@tcp:36:truncate.0 00010000:00010000:2.0:1789445889.989002:0:8204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445889.989089:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256b88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d75 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.989115:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:2.0:1789445889.989123:0:8204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789445889.989473:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.989490:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445889.989502:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789445889.989566:0:8204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1789445889.989596:0:8204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0012677 reply state 00000000c5001a4e transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445889.989607:0:8204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789445889.989727:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+45:11480:x1876369722120320:12345-192.168.206.59@tcp:36:truncate.0 Request processed in 848us (1175us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789445889.989736:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 156 00000020:00080000:2.0:1789445889.989752:0:8204:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789445889.992303:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.992325:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.992334:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.992354:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bee00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445889.992360:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.992369:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.992393:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:0.0:1789445889.992396:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445889.992402:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445889.992409:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256b8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789445890.167871:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1789445890.167899:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1789445890.178236:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445890.178393:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722120448 00000100:00100000:0.0:1789445890.178406:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722120448 00000100:00100000:0.0:1789445890.178501:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 157 00000100:00100000:0.0:1789445890.178513:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+44:11495:x1876369722120448:12345-192.168.206.59@tcp:101:stat.0 00010000:00010000:0.0:1789445890.178544:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445890.178569:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256b96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d7c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.178671:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256b9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.178691:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256b9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.178707:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256b9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.178732:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256ba4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.178739:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.178746:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.178886:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256bab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.178896:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256bab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.178927:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256bab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445890.178973:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789445890.178979:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789445890.179004:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256bab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179018:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256bab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179027:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256b9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179035:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256b9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179096:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256b9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179105:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445890.179111:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256b9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179124:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256b9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179138:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:0.0:1789445890.179141:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00080000:3.0:1789445890.179461:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789445890.179555:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256b9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179576:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256b9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179593:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179599:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256ba4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179605:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179610:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445890.179613:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179620:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179629:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe98961c00) 00010000:00010000:0.0:1789445890.179632:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445890.179635:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256ba4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179642:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256ba4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179684:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256b96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d7c expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179698:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256bab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d7c expref: 45 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.179713:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:0.0:1789445890.179716:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789445890.179720:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906800, rc 0) 00000100:00100000:0.0:1789445890.183116:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+45:11495:x1876369722120448:12345-192.168.206.59@tcp:101:stat.0 Request processed in 4586us (4878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445890.183132:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 157 00000100:00100000:2.0:1789445890.299443:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445890.300136:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722120704 00000100:00100000:0.0:1789445890.300152:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722120704 00000100:00100000:0.0:1789445890.300234:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 158 00000100:00100000:0.0:1789445890.300246:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+45:11505:x1876369722120704:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:0.0:1789445890.300273:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445890.300298:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256bb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d83 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445890.300467:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789445890.300651:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256bb2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d83 expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.300668:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961000) 00010000:00010000:0.0:1789445890.300672:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789445890.300678:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256bb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d83 expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.300696:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906400, rc 0) 00000100:00100000:0.0:1789445890.301033:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+46:11505:x1876369722120704:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 786us (1601us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1789445890.301150:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 158 00000100:00100000:3.0:1789445890.308828:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445890.309031:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722120960 00000100:00100000:2.0:1789445890.309221:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722120960 00000100:00100000:2.0:1789445890.309692:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 44 00000100:00100000:2.0:1789445890.309705:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c00c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+46:11505:x1876369722120960:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:2.0:1789445890.310035:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c00c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+47:11505:x1876369722120960:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 332us (1232us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789445890.310074:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 44 00000100:00100000:1.0:1789445890.422473:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445890.422584:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722121216 00000100:00100000:2.0:1789445890.422599:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722121216 00000100:00100000:2.0:1789445890.422674:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 159 00000100:00100000:2.0:1789445890.422687:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+47:11511:x1876369722121216:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:2.0:1789445890.422721:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445890.422851:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256bc0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d8a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.422995:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bc7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.423013:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256bab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d7c expref: 48 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.423022:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bc7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.423257:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256bab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d7c expref: 48 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.423273:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256bab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d7c expref: 48 pid: 5840 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445890.423313:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebfbc8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742046080:192.168.206.59@tcp:104: 00000100:00100000:3.0:1789445890.423478:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebffd7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789445890.436601:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445890.436688:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722121344 00000100:00100000:0.0:1789445890.436701:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722121344 00010000:00010000:0.0:1789445890.436770:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256bab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d7c expref: 49 pid: 5840 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445890.436828:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 67 00000100:00100000:0.0:1789445890.436843:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+49:2374:x1876369722121344:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789445890.436881:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445890.436891:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256bab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d7c expref: 49 pid: 5840 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.436909:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256bab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d7c expref: 49 pid: 5840 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.436943:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:0.0:1789445890.436949:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bc7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.436961:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.436971:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bc7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.437006:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445890.437129:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+49:2374:x1876369722121344:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 288us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445890.437163:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 67 00010000:00010000:1.0:1789445890.437823:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906800/0xc1b37c4d47256bab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d7c expref: 48 pid: 5840 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445890.437849:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebfbc8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742046080:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789445890.437952:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.437972:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.438071:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445890.438105:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789445890.438418:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256bc0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d8a expref: 49 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.438438:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bc7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d8a expref: 48 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.438446:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:1.0:1789445890.438450:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789445890.438454:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf000, rc 0) 00000100:00100000:1.0:1789445890.438562:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+48:11511:x1876369722121216:12345-192.168.206.59@tcp:101:bash.0 Request processed in 15877us (16102us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1789445890.438570:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 159 00000100:00100000:3.0:1789445890.441653:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445890.441929:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722121600 00000100:00100000:0.0:1789445890.441941:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722121600 00000100:00100000:0.0:1789445890.442372:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 160 00000100:00100000:0.0:1789445890.442386:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+48:11511:x1876369722121600:12345-192.168.206.59@tcp:36:bash.0 00010000:00010000:0.0:1789445890.442753:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256bd5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.442776:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256bd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.442791:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256bd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789445890.442848:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1789445890.442871:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ac668bd reply state 00000000afb890b4 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256bd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445890.442891:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789445890.443009:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+51:11511:x1876369722121600:12345-192.168.206.59@tcp:36:bash.0 Request processed in 625us (1371us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789445890.443018:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 160 00000020:00080000:0.0:1789445890.443025:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789445890.446968:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256bd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.446993:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256bd5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.447003:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256bd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.447010:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445890.447041:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256bd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.447096:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256bd5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.447120:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:1.0:1789445890.447123:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445890.447131:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256bd5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.447139:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907800/0xc1b37c4d47256bd5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445890.448320:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445890.448387:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722121728 00000100:00100000:1.0:1789445890.448405:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722121728 00000100:00100000:1.0:1789445890.448563:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 161 00000100:00100000:1.0:1789445890.448577:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+50:11511:x1876369722121728:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:1.0:1789445890.448619:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445890.448652:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256bdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d91 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.448859:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256be3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.448877:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bc7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d8a expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.448887:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256be3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.448959:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bc7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d8a expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.449042:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bc7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d8a expref: 51 pid: 5841 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445890.449091:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba73d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742046208:192.168.206.59@tcp:104: 00000100:00100000:1.0:1789445890.449222:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afd82cb4480 going to sleep for 11 seconds 00000100:00100000:0.0:1789445890.454432:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445890.454548:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722121856 00000100:00100000:2.0:1789445890.454574:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722121856 00010000:00010000:2.0:1789445890.454630:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bc7 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d8a expref: 52 pid: 5841 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445890.454701:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 68 00000100:00100000:2.0:1789445890.454714:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+52:2374:x1876369722121856:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445890.454737:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445890.454745:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bc7 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d8a expref: 52 pid: 5841 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.454762:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bc7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d8a expref: 52 pid: 5841 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.454791:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:2.0:1789445890.454798:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256be3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.454809:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256be3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.454819:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256be3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.454844:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445890.455138:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+52:2374:x1876369722121856:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 424us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445890.455158:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 68 00010000:00010000:1.0:1789445890.455744:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bc7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d8a expref: 51 pid: 5841 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445890.455770:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba73d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742046208:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789445890.455804:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256be3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.455816:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256be3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.455823:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256be3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445890.455954:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789445890.455960:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789445890.456078:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256be3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.456122:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ec00/0xc1b37c4d47256bdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d91 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.456288:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256be3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d91 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.456298:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:1.0:1789445890.456302:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789445890.456306:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6e200, rc 0) 00000100:00100000:1.0:1789445890.456368:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+50:11511:x1876369722121728:12345-192.168.206.59@tcp:101:bash.0 Request processed in 7794us (8495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445890.456376:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 161 00000100:00100000:2.0:1789445890.459653:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445890.460090:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722122112 00000100:00100000:0.0:1789445890.460106:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722122112 00000100:00100000:0.0:1789445890.460560:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 45 00000100:00100000:0.0:1789445890.460574:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+50:11511:x1876369722122112:12345-192.168.206.59@tcp:35:bash.0 00000100:00100000:0.0:1789445890.460987:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+51:11511:x1876369722122112:12345-192.168.206.59@tcp:35:bash.0 Request processed in 415us (1350us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1789445890.460997:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 45 00000100:00100000:0.0:1789445890.510625:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445890.510951:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722122368 00000100:00100000:2.0:1789445890.510967:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722122368 00000100:00100000:2.0:1789445890.511077:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 162 00000100:00100000:2.0:1789445890.511110:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+51:11521:x1876369722122368:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:2.0:1789445890.511156:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445890.511187:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d98 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445890.511325:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789445890.511507:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d98 expref: 53 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.511529:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961000) 00010000:00010000:2.0:1789445890.511533:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789445890.511539:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256bea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d98 expref: 53 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.511555:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf000, rc 0) 00000100:00100000:2.0:1789445890.511642:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+52:11521:x1876369722122368:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 536us (1034us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1789445890.511650:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 162 00000100:00100000:3.0:1789445890.515821:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445890.526996:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722122496 00000100:00100000:1.0:1789445890.527024:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722122496 00000100:00100000:1.0:1789445890.527179:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 163 00000100:00100000:1.0:1789445890.527194:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+52:11521:x1876369722122496:12345-192.168.206.59@tcp:34:lfs.0 00010000:00010000:1.0:1789445890.527330:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256bf8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527365:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527383:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527405:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256bff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527413:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527445:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527592:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256c06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527602:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527610:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789445890.527680:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527698:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527708:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256bf8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527722:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527729:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6fa00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445890.527735:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527744:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256bf8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527760:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:1.0:1789445890.527770:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445890.527779:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256bf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527787:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256bf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527808:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527813:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256bff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527819:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256bff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527825:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6f200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445890.527828:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256bff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527833:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256bff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527840:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe858f5400) 00010000:00010000:1.0:1789445890.527842:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445890.527844:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256bff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527850:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256bff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527868:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527880:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256c06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527897:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256c06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527904:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6ee00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445890.527908:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256c06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527915:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256c06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527927:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:1.0:1789445890.527931:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445890.527935:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256c06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.527940:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ee00/0xc1b37c4d47256c06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445890.529902:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+52:11521:x1876369722122496:12345-192.168.206.59@tcp:34:lfs.0 Request processed in 853us (12237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445890.529930:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 163 00000100:00100000:1.0:1789445890.531465:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445890.531877:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722122752 00000100:00100000:3.0:1789445890.531905:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722122752 00000100:00100000:3.0:1789445890.531989:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 46 00000100:00100000:3.0:1789445890.532012:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+52:11521:x1876369722122752:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:3.0:1789445890.533541:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+53:11521:x1876369722122752:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 1518us (2239us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789445890.533558:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 46 00000100:00100000:0.0:1789445890.586569:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445890.586730:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722123008 00000100:00100000:2.0:1789445890.586745:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722123008 00000100:00100000:2.0:1789445890.586818:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 164 00000100:00100000:2.0:1789445890.586830:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+53:11524:x1876369722123008:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:2.0:1789445890.586869:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445890.586904:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256c0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4d9f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.587011:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256c14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.587096:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256c14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.587111:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256c14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.587130:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256c1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.587136:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256c1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.587156:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256c1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.588122:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256c22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.588249:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.588262:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445890.588278:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789445890.588547:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256c14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.588557:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256c14 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.588564:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256c14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.588571:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bfc00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445890.588576:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256c14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.588585:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256c14 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.588620:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:0.0:1789445890.588624:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445890.588630:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256c14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.588637:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256c14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.588656:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256c1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.588663:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256c1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.588669:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256c1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.588685:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445890.588688:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256c1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.588695:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256c1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.588704:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe90eac900) 00010000:00010000:0.0:1789445890.588707:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445890.588710:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256c1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.589035:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256c1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.590495:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256c0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d9f expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.590531:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d9f expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.590540:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:0.0:1789445890.590543:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789445890.590547:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907200, rc 0) 00000100:00100000:0.0:1789445890.590724:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:11524:x1876369722123008:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 3886us (4159us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1789445890.590734:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 164 00000100:00100000:0.0:1789445890.595002:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445890.595152:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445890.595388:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722123264 00000100:00100000:2.0:1789445890.595401:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722123264 00000100:00100000:2.0:1789445890.595518:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 165 00000100:00100000:2.0:1789445890.595530:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:11524:x1876369722123264:12345-192.168.206.59@tcp:54:lfs.0 00010000:00010000:2.0:1789445890.595623:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.595646:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.595663:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.595710:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.595741:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.595749:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.595756:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445890.595762:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.595772:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.595787:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:2.0:1789445890.595790:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789445890.595796:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.595802:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445890.595900:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:11524:x1876369722123264:12345-192.168.206.59@tcp:54:lfs.0 Request processed in 371us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445890.595908:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 165 00000100:00100000:3.0:1789445890.599181:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722123136 00000100:00100000:3.0:1789445890.599203:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722123136 00000100:00100000:3.0:1789445890.599299:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 12 00000100:00100000:3.0:1789445890.599325:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:2375:x1876369722123136:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445890.599360:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445890.599402:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256c22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d9f expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.599431:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:3.0:1789445890.599437:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445890.599960:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+54:2375:x1876369722123136:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 635us (4970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445890.599996:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 12 00000100:00100000:0.0:1789445890.603010:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445890.607404:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722123520 00000100:00100000:3.0:1789445890.607426:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722123520 00000100:00100000:2.0:1789445890.607567:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 47 00000100:00100000:2.0:1789445890.607583:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+54:11524:x1876369722123520:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:2.0:1789445890.607943:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:11524:x1876369722123520:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 362us (4951us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789445890.607971:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 47 00000100:00100000:0.0:1789445890.768831:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445890.769106:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722123776 00000100:00100000:1.0:1789445890.769120:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722123776 00000100:00100000:1.0:1789445890.769207:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 166 00000100:00100000:1.0:1789445890.769223:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:11542:x1876369722123776:12345-192.168.206.59@tcp:101:cat.0 00010000:00010000:1.0:1789445890.769290:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445890.769323:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256c37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4da6 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.769502:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256c3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.769522:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256c3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.769536:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256c3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445890.769551:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789445890.769769:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256c37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4da6 expref: 58 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.769976:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256c3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4da6 expref: 57 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445890.769988:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:1.0:1789445890.769991:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789445890.769996:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6fa00, rc 0) 00000100:00100000:1.0:1789445890.770365:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+57:11542:x1876369722123776:12345-192.168.206.59@tcp:101:cat.0 Request processed in 1145us (1549us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789445890.770376:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 166 00010000:00010000:1.0:1789445890.779469:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445890.806819:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445890.806967:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722123904 00000100:00100000:2.0:1789445890.806982:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722123904 00000100:00100000:2.0:1789445890.807178:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 167 00000100:00100000:2.0:1789445890.807192:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf66b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+57:11543:x1876369722123904:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:2.0:1789445890.807231:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445890.807263:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4dad expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.807376:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256c53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.807397:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.807413:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445890.807471:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789445890.807476:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789445890.807512:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.807547:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dad expref: 59 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.807572:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256c53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dad expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.807600:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:2.0:1789445890.807604:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789445890.807609:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57be800, rc 0) 00000100:00100000:2.0:1789445890.807701:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf66b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+58:11543:x1876369722123904:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 512us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445890.807710:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 167 00000100:00100000:3.0:1789445890.824664:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445890.824757:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722124288 00000100:00100000:2.0:1789445890.824772:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722124288 00000100:00100000:2.0:1789445890.824854:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 48 00000100:00100000:2.0:1789445890.824879:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+58:11543:x1876369722124288:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:2.0:1789445890.825479:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:11543:x1876369722124288:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 610us (842us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789445890.825490:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 48 00000100:00100000:0.0:1789445890.835502:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445890.836093:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722124416 00000100:00100000:2.0:1789445890.836114:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722124416 00000100:00100000:2.0:1789445890.836222:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 13 00000100:00100000:2.0:1789445890.836235:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf669f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:11543:x1876369722124416:12345-192.168.206.59@tcp:103:lfs.0 00010000:00010000:2.0:1789445890.836255:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789445890.836290:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e200/0xc1b37c4d47256be3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d91 expref: 59 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.836316:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47256c3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4da6 expref: 58 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.836330:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256aee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d52 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445890.836370:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:2.0:1789445890.836385:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445890.836491:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf669f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+56:11543:x1876369722124416:12345-192.168.206.59@tcp:103:lfs.0 Request processed in 260us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445890.836500:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 13 00000100:00100000:3.0:1789445890.839364:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445890.843446:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722124544 00000100:00100000:0.0:1789445890.843479:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722124544 00000100:00100000:0.0:1789445890.843767:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 168 00000100:00100000:0.0:1789445890.843782:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+56:11543:x1876369722124544:12345-192.168.206.59@tcp:58:lfs.0 00010000:00010000:0.0:1789445890.843977:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256c5a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.844014:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256c5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445890.844094:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256c5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789445890.845691:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789445890.847501:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+56:11543:x1876369722124544:12345-192.168.206.59@tcp:58:lfs.0 Request processed in 3702us (8142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445890.847524:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 168 00000100:00100000:1.0:1789445890.869173:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445890.869573:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722124672 00000100:00100000:3.0:1789445890.869589:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722124672 00000100:00100000:3.0:1789445890.869675:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 169 00000100:00100000:3.0:1789445890.869690:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+56:11545:x1876369722124672:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445890.869730:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445890.869760:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256c61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4db4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.870080:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256c68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.870100:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256c68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.870127:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256c68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.870369:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256c6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.870380:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256c6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.870389:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256c6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.870528:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256c76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.870538:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256c76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.870545:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256c76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445890.870597:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789445890.870602:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789445890.870627:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256c76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.870643:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256c76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.870651:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256c68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.870658:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256c68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.870665:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256c68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.870672:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fd200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445890.870678:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256c68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.870686:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256c68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.870707:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:3.0:1789445890.871708:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445890.872399:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256c68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.872423:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256c68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.872457:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256c6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.872464:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256c6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.872472:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256c6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.872478:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fce00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445890.872483:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256c6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.872491:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256c6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.872508:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe8e97ab00) 00010000:00010000:3.0:1789445890.872511:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445890.872515:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256c6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.872521:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256c6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.872620:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256c61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4db4 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.872654:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256c76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4db4 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445890.872664:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:3.0:1789445890.872666:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789445890.872670:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fc200, rc 0) 00000100:00100000:3.0:1789445890.878139:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+57:11545:x1876369722124672:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 8431us (8968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445890.881023:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 169 00000040:00080000:0.0:1789445891.418382:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789445891.418394:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789445891.418449:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789445891.418458:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789445891.418609:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf66a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1876369742046336:192.168.206.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789445891.418725:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb56f53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445891.427122:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf66a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1876369742046336:192.168.206.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789445891.435734:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445891.436283:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722124800 00000100:00100000:2.0:1789445891.436298:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722124800 00000100:00100000:2.0:1789445891.436389:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 170 00000100:00100000:2.0:1789445891.436402:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+57:11556:x1876369722124800:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789445891.436447:0:8204:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789445891.436591:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+57:11556:x1876369722124800:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 Request processed in 191us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445891.436598:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 170 00000100:00100000:0.0:1789445891.451599:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445891.456278:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722124928 00000100:00100000:1.0:1789445891.456303:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722124928 00000100:00100000:1.0:1789445891.456495:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 171 00000100:00100000:1.0:1789445891.456507:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf66a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+57:11556:x1876369722124928:12345-192.168.206.59@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789445891.456579:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256c7d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.456597:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256c7d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.456610:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256c7d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462232:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256c84 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462254:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256c84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462265:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256c84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462298:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256c8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462307:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256c8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462314:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256c8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445891.462416:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789445891.462421:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789445891.462443:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256c8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462456:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256c7d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462463:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256c7d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462470:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256c7d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462475:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6fe00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445891.462479:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256c7d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462486:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256c7d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462498:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afe858f5c00) 00010000:00010000:1.0:1789445891.462501:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445891.462505:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256c7d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462511:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256c7d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462523:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256c84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462530:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256c84 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462536:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256c84 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462547:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6f800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445891.462550:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256c84 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462556:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256c84 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462565:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9afe858f5400) 00010000:00010000:1.0:1789445891.462568:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445891.462571:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256c84 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462577:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256c84 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462591:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256c8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462597:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256c8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462603:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256c8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462608:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445891.462611:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256c8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462617:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256c8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462636:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:1.0:1789445891.462638:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445891.462641:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256c8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.462648:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e000/0xc1b37c4d47256c8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445891.462737:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf66a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+57:11556:x1876369722124928:12345-192.168.206.59@tcp:34:lhsmtool_posix.0 Request processed in 6228us (11147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445891.462746:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 171 00000100:00100000:3.0:1789445891.470829:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445891.470913:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722125184 00000100:00100000:2.0:1789445891.470924:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722125184 00000100:00100000:2.0:1789445891.470984:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 172 00000100:00100000:2.0:1789445891.470994:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+57:11556:x1876369722125184:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789445891.471013:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445891.471033:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256c92 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4dbb expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.471186:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.471202:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.471229:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445891.471240:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789445891.471350:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.471359:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.471366:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.471371:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445891.471375:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.471382:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.471393:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:2.0:1789445891.471396:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789445891.471401:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.471407:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256c99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.471450:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256c92 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dbb expref: 59 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.471473:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afe858f5c00) 00010000:00010000:2.0:1789445891.471476:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789445891.471480:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256c92 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dbb expref: 59 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.471489:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf600, rc 0) 00000100:00100000:2.0:1789445891.471558:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+58:11556:x1876369722125184:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 564us (738us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1789445891.471565:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 172 00000100:00100000:0.0:1789445891.510310:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445891.510815:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722125312 00000100:00100000:1.0:1789445891.510827:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722125312 00000100:00100000:1.0:1789445891.510881:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 173 00000100:00100000:1.0:1789445891.510892:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+58:11556:x1876369722125312:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789445891.510931:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789445891.511033:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+58:11556:x1876369722125312:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 Request processed in 143us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445891.511040:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 173 00000100:00100000:2.0:1789445891.517788:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445891.518142:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722125568 00000100:00100000:1.0:1789445891.518154:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722125568 00000100:00100000:1.0:1789445891.518314:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 174 00000100:00100000:1.0:1789445891.518326:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+58:11556:x1876369722125568:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789445891.518358:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445891.518362:0:8204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789445891.518387:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256c53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dad expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.518411:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:1.0:1789445891.518417:0:8204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789445891.518433:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256ca7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4dc2 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789445891.519430:0:8204:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789445891.519853:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256cae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.520328:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256cae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.520354:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256cae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.520426:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256ca7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dc2 expref: 60 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.520444:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256cae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dc2 expref: 59 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.520452:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9afe858f5400) 00010000:00010000:1.0:1789445891.520455:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789445891.520459:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6fe00, rc 0) 00000100:00100000:1.0:1789445891.520524:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:11556:x1876369722125568:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 2201us (2748us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1789445891.520533:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 174 00000100:00100000:1.0:1789445891.532031:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445891.532530:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722125824 00000100:00100000:3.0:1789445891.532540:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722125824 00000100:00100000:3.0:1789445891.532599:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 175 00000100:00100000:3.0:1789445891.532609:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:11556:x1876369722125824:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789445891.533225:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445891.533251:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256cae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dc2 expref: 59 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533269:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9afe858f5400) 00010000:00010000:3.0:1789445891.533279:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789445891.533299:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256cbc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533328:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256cbc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533359:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256cbc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533375:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256cc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf266c886 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533383:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256cc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf266c886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533390:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256cc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf266c886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533448:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256cbc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533456:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256cbc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533463:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256cbc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533468:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fce00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445891.533473:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256cbc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533480:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256cbc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533489:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:3.0:1789445891.533498:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445891.533503:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256cbc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533510:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256cbc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533521:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256cc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf266c886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533527:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256cc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf266c886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533534:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256cc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf266c886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533539:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445891.533542:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256cc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf266c886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533549:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256cc3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf266c886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533557:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf266c886 (ffff9afe8e97ab00) 00010000:00010000:3.0:1789445891.533559:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445891.533562:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256cc3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf266c886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.533568:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256cc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf266c886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445891.533642:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+58:11556:x1876369722125824:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 Request processed in 1034us (1619us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789445891.533655:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 175 00000100:00100000:0.0:1789445891.544028:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445891.544391:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722125952 00000100:00100000:2.0:1789445891.544401:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722125952 00000100:00100000:2.0:1789445891.544466:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 176 00000100:00100000:2.0:1789445891.544477:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf66aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+58:11556:x1876369722125952:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789445891.544498:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445891.544521:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256cca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4dc9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.544582:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256cd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.544595:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.544607:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.544735:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256cca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dc9 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.544752:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dc9 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.544760:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:2.0:1789445891.544763:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789445891.544767:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bee00, rc 0) 00000100:00100000:2.0:1789445891.544837:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf66aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:11556:x1876369722125952:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 362us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445891.544845:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 176 00000100:00100000:3.0:1789445891.584211:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445891.584414:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722126208 00000100:00100000:1.0:1789445891.584426:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722126208 00000100:00100000:1.0:1789445891.584497:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 177 00000100:00100000:1.0:1789445891.584511:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:11556:x1876369722126208:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789445891.584596:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256cd8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.584614:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.584626:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789445891.585501:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1789445891.585521:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329607474453ns, next at 330607471635ns, rc = 0 00000004:00010000:1.0:1789445891.585647:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a59a64b reply state 000000003846e721 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445891.585658:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789445891.586032:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+61:11556:x1876369722126208:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 Request processed in 1521us (2196us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1789445891.586042:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 177 00000100:00100000:2.0:1789445891.590953:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00010000:00010000:2.0:1789445891.590990:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.591003:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256cd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.591011:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256cd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.591017:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6f800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445891.591023:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256cd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.591032:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256cd8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.593725:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:2.0:1789445891.593729:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789445891.593737:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256cd8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.593745:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f800/0xc1b37c4d47256cd8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445891.593787:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722126336 00000100:00100000:2.0:1789445891.593795:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722126336 00000100:00100000:2.0:1789445891.593855:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 178 00000100:00100000:2.0:1789445891.593863:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+60:11556:x1876369722126336:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789445891.593884:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445891.593900:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256cdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4dd0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.593948:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256cdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dd0 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.593960:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256cdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dd0 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.593975:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:2.0:1789445891.593977:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789445891.593980:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf600, rc 0) 00000100:00100000:2.0:1789445891.594034:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+61:11556:x1876369722126336:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 172us (3089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445891.594073:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 178 00000100:00100000:0.0:1789445891.604405:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445891.604547:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722126464 00000100:00100000:1.0:1789445891.604559:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722126464 00000100:00100000:1.0:1789445891.604643:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 50 00000100:00100000:1.0:1789445891.604656:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2374:x1876369722126464:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789445891.605030:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2374:x1876369722126464:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 Request processed in 376us (633us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789445891.605082:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 50 00000100:00080000:2.0:1789445891.605478:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789445891.609850:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445891.613508:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722126720 00000100:00100000:0.0:1789445891.613523:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722126720 00000100:00100000:0.0:1789445891.613589:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 49 00000100:00100000:0.0:1789445891.613599:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+61:11556:x1876369722126720:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789445891.613863:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+62:11556:x1876369722126720:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 Request processed in 264us (4020us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789445891.613871:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 49 00000100:00100000:2.0:1789445891.621642:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445891.622275:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722126976 00000100:00100000:0.0:1789445891.622301:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722126976 00000100:00100000:0.0:1789445891.622369:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 179 00000100:00100000:0.0:1789445891.622381:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+62:11556:x1876369722126976:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789445891.622513:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+62:11556:x1876369722126976:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 Request processed in 134us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445891.622520:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 179 00000100:00100000:3.0:1789445891.628929:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445891.629026:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722127104 00000100:00100000:2.0:1789445891.629036:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722127104 00000100:00100000:2.0:1789445891.629122:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 180 00000100:00100000:2.0:1789445891.629132:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+62:11556:x1876369722127104:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789445891.629161:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445891.629182:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256ce6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4dd7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.629253:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256ced lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.629268:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256ced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.629279:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256ced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445891.629311:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789445891.629328:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256ced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.629368:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256ce6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dd7 expref: 64 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.629385:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256ced lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dd7 expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.629407:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:2.0:1789445891.629410:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789445891.629413:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf400, rc 0) 00000100:00100000:2.0:1789445891.629475:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+63:11556:x1876369722127104:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 344us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445891.629483:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 180 00000100:00100000:2.0:1789445891.640370:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445891.640928:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722127232 00000100:00100000:0.0:1789445891.640938:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722127232 00000100:00100000:0.0:1789445891.640997:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 51 00000100:00100000:0.0:1789445891.641008:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2375:x1876369722127232:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789445891.641025:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445891.641057:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d47256cf4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4dde expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789445891.641082:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa8c703, blocks: 0x1 00010000:00010000:0.0:1789445891.641100:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=329s v=(0 0) 00010000:00010000:0.0:1789445891.641104:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445891.641113:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d47256cf4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dde expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.641131:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d47256cf4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dde expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.641145:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906e00, rc 0) 00000100:00100000:0.0:1789445891.641213:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2375:x1876369722127232:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 207us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445891.641227:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 51 00000100:00100000:2.0:1789445891.644651:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445891.644840:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722127488 00000100:00100000:3.0:1789445891.644850:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722127488 00000100:00100000:3.0:1789445891.644904:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 181 00000100:00100000:3.0:1789445891.644914:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+63:11556:x1876369722127488:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789445891.645022:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+63:11556:x1876369722127488:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 Request processed in 109us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445891.645030:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 181 00000100:00100000:0.0:1789445891.654156:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445891.655040:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722127616 00000100:00100000:3.0:1789445891.655066:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722127616 00000100:00100000:0.0:1789445891.655120:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 52 00000100:00100000:0.0:1789445891.655133:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:11556:x1876369722127616:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789445891.655161:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445891.655179:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053e48d19/0xc1b37c4d47256cfb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4de5 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.655209:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d47256cf4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dde expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.655218:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445891.655223:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445891.655228:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053e48d19/0xc1b37c4d47256cfb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4de5 expref: 9 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.655259:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d47256cf4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dde expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.655273:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d47256cf4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dde expref: 9 pid: 6682 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445891.655287:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf669500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1876369742046464:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445891.655385:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb56f53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445891.659557:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445891.659601:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722127744 00000100:00100000:0.0:1789445891.659609:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722127744 00010000:00010000:0.0:1789445891.659658:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d47256cf4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dde expref: 10 pid: 6682 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445891.659714:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 69 00000100:00100000:0.0:1789445891.659725:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe87d85050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+10:2375:x1876369722127744:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789445891.659741:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445891.659766:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d47256cf4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dde expref: 10 pid: 6682 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.659781:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d47256cf4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dde expref: 10 pid: 6682 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.659808:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445891.659814:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445891.659823:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053e48d19/0xc1b37c4d47256cfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4de5 expref: 10 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.659834:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053e48d19/0xc1b37c4d47256cfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4de5 expref: 10 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.659871:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000053e48d19/0xc1b37c4d47256cfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4de5 expref: 10 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445891.659885:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf668000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5827:1876369742046592:192.168.206.59@tcp:105: 00000100:00100000:0.0:1789445891.659968:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb56f5e40 going to sleep for 11 seconds 00010000:00010000:2.0:1789445891.660937:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d47256cf4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dde expref: 10 pid: 6682 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445891.660955:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf669500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1876369742046464:192.168.206.59@tcp:104: 00010000:00010000:2.0:1789445891.660985:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000053e48d19/0xc1b37c4d47256cfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4de5 expref: 9 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.660997:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907e00, rc 0) 00000100:00100000:2.0:1789445891.661072:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:11556:x1876369722127616:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 5941us (6932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445891.661081:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 52 00000100:00100000:1.0:1789445891.670132:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf668000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5827:1876369742046592:192.168.206.59@tcp:105: 00010000:00010000:1.0:1789445891.670167:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445891.670230:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe87d85050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2375:x1876369722127744:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 10506us (10682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445891.670242:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 69 00000100:00100000:3.0:1789445891.677347:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445891.677463:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722127872 00000100:00100000:1.0:1789445891.677473:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722127872 00002000:00100000:1.0:1789445891.677530:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9afebfbc9880 x1876369722127872/t0(0) o4->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:17/0 lens 504/0 e 0 to 0 dl 1789445902 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789445891.677540:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afebfbc9880 with x1876369722127872 ext(0->8) 00002000:00010000:1.0:1789445891.677546:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afebfbc9880 00000100:00100000:1.0:1789445891.677580:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 4 00000100:00100000:1.0:1789445891.677589:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2374:x1876369722127872:12345-192.168.206.59@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789445891.678088:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+10:2374:x1876369722127872:12345-192.168.206.59@tcp:4:lhsmtool_posix.0 Request processed in 497us (758us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789445891.678097:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 4 00002000:00100000:1.0:1789445891.678104:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9afebfbc9880 x1876369722127872/t4294967314(0) o4->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:17/0 lens 504/448 e 0 to 0 dl 1789445902 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789445891.678112:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afebfbc9880 with x1876369722127872 ext(0->8) 00002000:00010000:1.0:1789445891.678116:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afebfbc9880 00000100:00100000:1.0:1789445891.689829:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445891.690352:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722128000 00000100:00100000:3.0:1789445891.690365:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722128000 00000100:00100000:3.0:1789445891.690430:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 182 00000100:00100000:3.0:1789445891.690441:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+63:11556:x1876369722128000:12345-192.168.206.59@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789445891.760578:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+63:11556:x1876369722128000:12345-192.168.206.59@tcp:44:lhsmtool_posix.0 Request processed in 70133us (70751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445891.760590:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 182 00000001:00080000:3.0:1789445891.760621:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1789445891.760661:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:3.0:1789445891.760680:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789445891.760694:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9afd82cb4600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1789445891.760698:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afeb4bdd300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9afd82cb40c0 00000020:00080000:3.0:1789445891.760709:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afeb4bdda00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9afe89960800 00000100:00100000:3.0:1789445891.760864:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebfbc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742046720:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789445891.760910:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789445891.763870:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1789445891.764040:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789445891.764079:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742046720 00000100:00100000:0.0:1789445891.764087:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742046720 00000100:00100000:0.0:1789445891.764138:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789445891.764406:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445891.765203:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742046720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789445891.765377:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789445891.765381:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789445891 00002000:00010000:0.0:1789445891.765384:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789445891.765386:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789445891 -> 1789445891 00002000:00010000:0.0:1789445891.765388:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789445891.765452:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1876369742046720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 255us (4540us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789445891.765460:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789445891.765487:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722128128 00000100:00100000:0.0:1789445891.765494:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722128128 00000100:00100000:0.0:1789445891.765521:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 54 00000100:00100000:0.0:1789445891.765527:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+10:2375:x1876369722128128:12345-192.168.206.59@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789445891.765578:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742046848:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789445891.765612:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445891.765653:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742046848 00000100:00100000:0.0:1789445891.765657:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742046848 00000100:00100000:0.0:1789445891.768359:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789445891.768376:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742046848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789445891.768407:0:11692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1789445891.768450:0:11692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa8c700, atime: 0x6aa8c700, ctime: 0x6aa8c700, blocks: 0xb 00010000:00010000:0.0:1789445891.768458:0:11692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd59ba0f/0xc1b37c4d47256d02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.768473:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:0.0:1789445891.768476:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445891.768482:0:11692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd59ba0f/0xc1b37c4d47256d02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.768498:0:11692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd59ba0f/0xc1b37c4d47256d02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.768509:0:11692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd59ba0f/0xc1b37c4d47256d02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.768516:0:11692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd59ba0f/0xc1b37c4d47256d02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.768536:0:11692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789445891.769180:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1876369742046848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 808us (3564us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789445891.769189:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:0.0:1789445891.769219:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445891.769226:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd59ba0f/0xc1b37c4d47256d02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.769235:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907c00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445891.769246:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd59ba0f/0xc1b37c4d47256d02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.769256:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd59ba0f/0xc1b37c4d47256d02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.769275:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd59ba0f/0xc1b37c4d47256d02 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.769283:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd59ba0f/0xc1b37c4d47256d02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.769303:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445891.769305:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445891.769307:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445891.769351:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1789445891.769358:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1789445891.769381:0:3311:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9afebf668e00 x1876369742046848/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789445907 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789445891.769392:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afebf668e00/2, rc 0, transno 4294967307 00000100:00100000:0.0:1789445891.769398:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742046848:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789445891.769427:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afebfbc9c00/2, rc 0, transno 4294967315 00000100:00100000:0.0:1789445891.769432:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebfbc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742046720:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1789445891.769910:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789445891.769916:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789445891.803623:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789445891.808203:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1789445891.808219:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1789445891.808519:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2375:x1876369722128128:12345-192.168.206.59@tcp:16:lhsmtool_posix.0 Request processed in 42986us (44110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445891.808530:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 54 00000100:00100000:3.0:1789445891.811541:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445891.811647:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722128384 00000100:00100000:0.0:1789445891.811659:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722128384 00000100:00100000:0.0:1789445891.811732:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 183 00000100:00100000:0.0:1789445891.811744:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:11556:x1876369722128384:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789445891.811809:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445891.811835:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256ced lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dd7 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.811854:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:0.0:1789445891.811859:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789445891.811887:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256d09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.811900:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256d09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.811909:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256d09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789445891.812176:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030f1ad26 reply state 0000000062252b5f transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256d09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445891.812185:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789445891.812272:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:11556:x1876369722128384:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 Request processed in 530us (740us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789445891.812280:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 183 00010000:00010000:3.0:1789445891.814268:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256d09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.814286:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256d09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.814293:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256d09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.814300:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445891.814304:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256d09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.814311:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256d09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.814326:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:3.0:1789445891.814330:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445891.814349:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256d09 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.814355:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907c00/0xc1b37c4d47256d09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445891.817290:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445891.817682:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722128512 00000100:00100000:0.0:1789445891.817693:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722128512 00000100:00100000:0.0:1789445891.817745:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 56 00000100:00100000:0.0:1789445891.817755:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2374:x1876369722128512:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789445891.818008:0:11692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789445891.818012:0:11692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789445891 -> 1789445890 00002000:00010000:0.0:1789445891.818015:0:11692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789445888 00002000:00010000:0.0:1789445891.818017:0:11692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789445891 -> 1789445890 00002000:00010000:0.0:1789445891.818020:0:11692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789445891.818095:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2374:x1876369722128512:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 Request processed in 341us (815us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789445891.818104:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 56 00000100:00100000:2.0:1789445891.821024:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445891.821251:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722128768 00000100:00100000:3.0:1789445891.821273:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722128768 00000100:00100000:3.0:1789445891.821346:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 184 00000100:00100000:3.0:1789445891.821356:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:11556:x1876369722128768:12345-192.168.206.59@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789445891.821414:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.821430:0:8204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256cd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dc9 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.821439:0:8204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d10 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.821469:0:8204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dc9 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.821481:0:8204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dc9 expref: 18 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445891.821494:0:8204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8204:1876369742046976:192.168.206.59@tcp:104: 00000100:00100000:3.0:1789445891.821615:0:8204:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445891.834623:0:8204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8204:1876369742046976:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789445891.834656:0:8204:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445891.835736:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445891.835822:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722128896 00000100:00100000:3.0:1789445891.835832:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722128896 00010000:00010000:3.0:1789445891.835874:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dc9 expref: 19 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445891.835937:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 70 00000100:00100000:3.0:1789445891.835946:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:2375:x1876369722128896:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445891.835961:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445891.835968:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dc9 expref: 19 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.835981:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dc9 expref: 19 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.836004:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256cd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dc9 expref: 19 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.836021:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:3.0:1789445891.836026:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.836036:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.836080:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d10 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.836102:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445891.836161:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:2375:x1876369722128896:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 215us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445891.836169:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 70 00010000:00010000:3.0:1789445891.836194:0:8204:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.836207:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.836233:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.836239:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.836246:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.836251:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445891.836254:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.836260:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.836270:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:3.0:1789445891.836272:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789445891.836275:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d10 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.836280:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445891.836317:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+17:11556:x1876369722128768:12345-192.168.206.59@tcp:55:lhsmtool_posix.0 Request processed in 14963us (15301us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789445891.836326:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 184 00000100:00100000:2.0:1789445891.842682:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445891.842951:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722129024 00000100:00100000:3.0:1789445891.842961:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722129024 00000100:00100000:3.0:1789445891.843021:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 57 00000100:00100000:3.0:1789445891.843031:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2374:x1876369722129024:12345-192.168.206.59@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789445891.843091:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256d17 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.843112:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000053e48d19/0xc1b37c4d47256cfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4de5 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.843122:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445891.843126:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789445891.843131:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256d17 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.843179:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000053e48d19/0xc1b37c4d47256cfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4de5 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.843193:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000053e48d19/0xc1b37c4d47256cfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4de5 expref: 8 pid: 6684 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445891.843206:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876369742047104:192.168.206.59@tcp:104: 00000100:00100000:3.0:1789445891.843275:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445891.848358:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876369742047104:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789445891.848386:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256d17 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445891.849688:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445891.850913:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722129152 00000100:00100000:3.0:1789445891.850924:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722129152 00010000:00010000:3.0:1789445891.850964:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053e48d19/0xc1b37c4d47256cfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4de5 expref: 9 pid: 6684 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445891.851061:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 71 00000100:00100000:3.0:1789445891.851073:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf763100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:2375:x1876369722129152:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445891.851088:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445891.851113:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053e48d19/0xc1b37c4d47256cfb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4de5 expref: 9 pid: 6684 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.851129:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053e48d19/0xc1b37c4d47256cfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4de5 expref: 9 pid: 6684 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.851163:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053e48d19/0xc1b37c4d47256cfb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4de5 expref: 9 pid: 6684 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.851179:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789445891.851183:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789445891.851188:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256d17 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.851197:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256d17 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445891.851233:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445891.851287:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf763100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2375:x1876369722129152:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 216us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445891.851295:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 71 00010000:00010000:2.0:1789445891.851535:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256d17 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.851546:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256d17 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.851571:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256d17 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.851582:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256d17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.851591:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256d17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.851598:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fce00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445891.851603:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256d17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.851613:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256d17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.851625:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256d17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445891.851634:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a545d8b9/0xc1b37c4d47256d17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445891.851709:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2374:x1876369722129024:12345-192.168.206.59@tcp:1:lhsmtool_posix.0 Request processed in 8680us (9037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445891.851718:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 57 00000100:00100000:2.0:1789445891.860179:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445891.860391:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722129408 00000100:00100000:0.0:1789445891.860403:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722129408 00000100:00100000:0.0:1789445891.860464:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 185 00000100:00100000:0.0:1789445891.860474:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+17:11556:x1876369722129408:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789445891.860548:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256d1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.860566:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256d1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.860578:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256d1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.860797:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.860809:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256cdf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dd0 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.860818:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d25 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.860857:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256cdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dd0 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.860871:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256cdf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dd0 expref: 18 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445891.860886:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf66b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742047232:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445891.860973:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb56f5300 going to sleep for 11 seconds 00000100:00100000:3.0:1789445891.869298:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf66b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742047232:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789445891.869355:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445891.881200:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445891.881289:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722129536 00000100:00100000:0.0:1789445891.881299:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722129536 00010000:00010000:0.0:1789445891.881352:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256cdf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dd0 expref: 19 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445891.881390:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 72 00000100:00100000:0.0:1789445891.881399:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81215880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:2375:x1876369722129536:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789445891.881422:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445891.881429:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256cdf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dd0 expref: 19 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.881441:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256cdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dd0 expref: 19 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.881461:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256cdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dd0 expref: 19 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.881475:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:0.0:1789445891.881488:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.881497:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.881505:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d25 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.881530:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445891.881577:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81215880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:2375:x1876369722129536:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 179us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445891.881585:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 72 00010000:00010000:0.0:1789445891.881667:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.881676:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789445891.881856:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1789445891.882002:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1789445891.882081:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1789445891.882163:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf66a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876369742047360:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789445891.882206:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445891.882233:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb56f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789445891.882253:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742047360 00000100:00100000:0.0:1789445891.882258:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742047360 00000100:00100000:0.0:1789445891.882288:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789445891.882296:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf66bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1876369742047360:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789445891.882372:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf66bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1876369742047360:12345-0@lo:1000:mdt00_000.0 Request processed in 76us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445891.882386:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789445891.882422:0:5840:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1789445891.882428:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afebfbc9c00, transno 4294967315 00000100:00100000:0.0:1789445891.882441:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf66a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876369742047360:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789445891.882851:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1789445891.882903:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf66a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876369742047488:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789445891.882932:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445891.882949:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb56f5300 going to sleep for 11 seconds 00000100:00100000:0.0:1789445891.883162:0:12062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742047488 00000100:00100000:0.0:1789445891.883168:0:12062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742047488 00000100:00100000:0.0:1789445891.883198:0:12062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789445891.883206:0:12062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf66ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5840:x1876369742047488:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789445891.883542:0:12062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf66ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5840:x1876369742047488:12345-0@lo:1000:mdt00_000.0 Request processed in 336us (608us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789445891.883550:0:12062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789445891.883591:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf66a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5840:1876369742047488:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789445891.883623:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883634:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d25 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883642:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883649:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445891.883654:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883669:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d25 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883685:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9afe90eac800) 00010000:00010000:0.0:1789445891.883688:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789445891.883694:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d25 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883701:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d25 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883736:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256c5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883744:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256c5a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883750:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256c5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883755:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445891.883758:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256c5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883764:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256c5a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883771:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:0.0:1789445891.883773:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789445891.883776:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256c5a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883794:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256c5a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883817:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256d2c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883833:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256c76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4db4 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883843:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256d2c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883870:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256c76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4db4 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.883885:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256c76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4db4 expref: 21 pid: 5841 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445891.883896:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf668a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742047616:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445891.883963:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87ddee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789445891.896873:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf668a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742047616:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789445891.896911:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256d2c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445891.909468:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445891.909546:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722129664 00000100:00100000:0.0:1789445891.909555:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722129664 00010000:00010000:0.0:1789445891.909594:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256c76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4db4 expref: 22 pid: 5841 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445891.909642:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 73 00000100:00100000:0.0:1789445891.909653:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+22:2374:x1876369722129664:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789445891.909679:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445891.909687:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256c76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4db4 expref: 22 pid: 5841 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.909700:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256c76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4db4 expref: 22 pid: 5841 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.909722:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256c76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4db4 expref: 22 pid: 5841 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.909739:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:0.0:1789445891.909745:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256d2c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.909755:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256d2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.909763:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256d2c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.909786:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445891.909840:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:2374:x1876369722129664:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 189us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445891.909848:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 73 00010000:00010000:0.0:1789445891.909889:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256d2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.909904:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256d2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.909916:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256d2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.909924:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256d2c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.909931:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256d2c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.909937:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445891.909942:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256d2c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.909950:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256d2c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.909960:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:0.0:1789445891.909962:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445891.909965:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256d2c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.909972:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256d2c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.909982:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256d1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.909989:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256d1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.910000:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256d1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.910005:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445891.910007:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256d1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.910013:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256d1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.910020:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:0.0:1789445891.910023:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789445891.910026:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256d1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.910031:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256d1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445891.910403:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:11556:x1876369722129408:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 Request processed in 49929us (50230us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1789445891.910414:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 185 00000020:00080000:0.0:1789445891.910418:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789445891.910539:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789445891.910544:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789445891.912313:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1789445891.912330:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789445891.917740:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445891.917859:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722129920 00000100:00100000:0.0:1789445891.917869:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722129920 00000100:00100000:0.0:1789445891.917926:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 50 00000100:00100000:0.0:1789445891.917935:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c01850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:11556:x1876369722129920:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789445891.921007:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789445891.921777:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1789445891.921856:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256d33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.921878:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256d33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.921892:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256d33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.921903:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256d33 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.921911:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256d33 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.921917:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256d33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445891.921947:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789445891.922092:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c01850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+22:11556:x1876369722129920:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 Request processed in 4151us (4586us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1789445891.922103:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 50 00000020:00080000:0.0:1789445891.922110:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789445891.922862:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789445891.922873:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256d33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.922883:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906a00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445891.922888:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256d33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.922898:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256d33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.922912:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9afe98961900) 00010000:00010000:1.0:1789445891.922915:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789445891.922921:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256d33 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.922927:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d47256d33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445891.922948:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445891.922951:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445891.922953:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789445892.138154:0:12500:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789445892.138164:0:12500:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789445892.138208:0:12500:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789445892.138213:0:12500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789445892.191887:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789445892.191909:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf5bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742047744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789445892.191975:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445892.192162:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742047744 00000100:00100000:0.0:1789445892.192170:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742047744 00000100:00100000:0.0:1789445892.192225:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789445892.192234:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876369742047744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789445892.192265:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789445892.192327:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876369742047744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445892.192344:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789445892.192619:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf5bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742047744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789445892.363389:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445892.363595:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722130176 00000100:00100000:3.0:1789445892.363607:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722130176 00000100:00100000:3.0:1789445892.363702:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 186 00000100:00100000:3.0:1789445892.363713:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+22:11566:x1876369722130176:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445892.363744:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445892.363773:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4dec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.363893:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256d41 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.363909:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256d41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.363925:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256d41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445892.363938:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789445892.364099:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dec expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.364263:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256d41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dec expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.364273:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:3.0:1789445892.364285:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789445892.364289:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe813fd200, rc 0) 00000100:00100000:3.0:1789445892.364404:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:11566:x1876369722130176:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 692us (1028us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1789445892.364412:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 186 00000100:00080000:0.0:1789445892.366199:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445892.396476:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445892.396518:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722130304 00000100:00100000:3.0:1789445892.396529:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722130304 00000100:00100000:3.0:1789445892.396592:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 187 00000100:00100000:3.0:1789445892.396603:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:11566:x1876369722130304:12345-192.168.206.59@tcp:34:lfs.0 00010000:00010000:3.0:1789445892.397817:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.397839:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.397854:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.397879:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.397885:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.397892:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.398951:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256d5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.398981:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.398991:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789445892.400280:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400312:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400319:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400326:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400342:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445892.400347:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400356:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400371:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:3.0:1789445892.400375:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445892.400380:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400387:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400421:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400428:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400434:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400439:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445892.400442:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400447:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400455:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe8e97a400) 00010000:00010000:3.0:1789445892.400457:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445892.400461:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400467:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400488:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400495:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256d5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400500:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256d5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400512:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fce00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445892.400515:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256d5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400521:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256d5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400529:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe8e97ab00) 00010000:00010000:3.0:1789445892.400532:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445892.400535:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256d5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.400540:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256d5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445892.400774:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:11566:x1876369722130304:12345-192.168.206.59@tcp:34:lfs.0 Request processed in 4166us (4303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445892.400786:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 187 00000100:00100000:1.0:1789445892.507035:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445892.507434:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722130560 00000100:00100000:3.0:1789445892.507446:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722130560 00000100:00100000:3.0:1789445892.507506:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 188 00000100:00100000:3.0:1789445892.507516:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+24:11569:x1876369722130560:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445892.507535:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445892.507555:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256d64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4df3 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.507620:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.507648:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.507658:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.507684:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.507691:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.507697:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.507951:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256d79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.507960:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.507967:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445892.507977:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789445892.508278:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.508287:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d6b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.508294:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.508307:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445892.508311:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.508319:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d6b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.508419:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:3.0:1789445892.508424:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445892.508429:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.508436:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc200/0xc1b37c4d47256d6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.508449:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.508455:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.508462:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.508468:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe813fc000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445892.508471:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.508477:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.508497:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe8e97ab00) 00010000:00010000:3.0:1789445892.508499:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445892.508502:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.508508:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fc000/0xc1b37c4d47256d72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.508550:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fce00/0xc1b37c4d47256d64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4df3 expref: 27 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.508563:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256d79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4df3 expref: 26 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.508570:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe8e97a400) 00010000:00010000:3.0:1789445892.508572:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789445892.508575:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989400, rc 0) 00000100:00100000:3.0:1789445892.508644:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+26:11569:x1876369722130560:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 1129us (1620us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789445892.508651:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 188 00000100:00100000:0.0:1789445892.516190:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445892.516860:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722130688 00000100:00100000:2.0:1789445892.516873:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722130688 00000100:00100000:2.0:1789445892.516939:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 189 00000100:00100000:2.0:1789445892.516950:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+26:11569:x1876369722130688:12345-192.168.206.59@tcp:54:lfs.0 00010000:00010000:2.0:1789445892.517024:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256d87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.517093:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.517108:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.517378:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.517386:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256d87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.517394:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256d87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.517400:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bee00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445892.517405:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256d87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.517413:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256d87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.517426:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe8e97a400) 00010000:00010000:2.0:1789445892.517429:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789445892.517433:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256d87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.517439:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256d87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445892.517528:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+26:11569:x1876369722130688:12345-192.168.206.59@tcp:54:lfs.0 Request processed in 578us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445892.517538:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 189 00000100:00100000:1.0:1789445892.520356:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445892.520478:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722130944 00000100:00100000:2.0:1789445892.520488:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722130944 00000100:00100000:2.0:1789445892.520548:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 51 00000100:00100000:2.0:1789445892.520563:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+26:11569:x1876369722130944:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:2.0:1789445892.520771:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+27:11569:x1876369722130944:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 208us (424us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1789445892.520780:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 51 00000100:00100000:1.0:1789445892.556684:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445892.556795:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722131200 00000100:00100000:0.0:1789445892.556805:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722131200 00000100:00100000:0.0:1789445892.556910:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 190 00000100:00100000:0.0:1789445892.556924:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+27:11103:x1876369722131200:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:0.0:1789445892.556953:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445892.556977:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256d8e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4dfa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.557226:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d95 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.557242:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256d79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4df3 expref: 28 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.557251:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d95 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.557282:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256d79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4df3 expref: 28 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.557296:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256d79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4df3 expref: 28 pid: 8204 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445892.557343:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf66b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742047872:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445892.557486:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87ddef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789445892.564031:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445892.564937:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf66b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742047872:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789445892.565079:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d95 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445892.565824:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722131328 00000100:00100000:3.0:1789445892.565833:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722131328 00010000:00010000:3.0:1789445892.565873:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256d79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4df3 expref: 29 pid: 8204 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445892.565916:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 74 00000100:00100000:3.0:1789445892.565926:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf627480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+29:2375:x1876369722131328:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445892.566026:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445892.566062:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256d79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4df3 expref: 29 pid: 8204 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.566075:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256d79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4df3 expref: 29 pid: 8204 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.566164:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256d79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4df3 expref: 29 pid: 8204 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.566181:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe8e97a400) 00010000:00010000:3.0:1789445892.566186:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d95 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.566196:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.566203:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d95 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.566232:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445892.566294:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf627480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+28:2375:x1876369722131328:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 370us (2271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445892.566301:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 74 00010000:00010000:0.0:1789445892.566377:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.566385:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445892.566405:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789445892.566589:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906400/0xc1b37c4d47256d8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dfa expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.566618:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dfa expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.566625:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe8e97a400) 00010000:00010000:0.0:1789445892.566628:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789445892.566631:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907000, rc 0) 00000100:00100000:0.0:1789445892.566668:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+28:11103:x1876369722131200:12345-192.168.206.59@tcp:101:bash.0 Request processed in 9747us (9995us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1789445892.566675:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 190 00000100:00100000:1.0:1789445892.570533:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445892.575380:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722131584 00000100:00100000:3.0:1789445892.575394:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722131584 00000100:00100000:2.0:1789445892.577565:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 191 00000100:00100000:2.0:1789445892.577577:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+28:11103:x1876369722131584:12345-192.168.206.59@tcp:36:bash.0 00010000:00010000:2.0:1789445892.577834:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256da3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.577852:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256da3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.577865:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256da3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789445892.577916:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1789445892.577940:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d18dbcc reply state 0000000003324173 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256da3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445892.577950:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789445892.577994:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1789445892.578359:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+32:11103:x1876369722131584:12345-192.168.206.59@tcp:36:bash.0 Request processed in 782us (7833us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1789445892.578368:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 191 00000020:00080000:2.0:1789445892.578374:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789445892.587511:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00010000:00010000:2.0:1789445892.587566:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256da3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.587583:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256da3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445892.587601:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722131712 00010000:00010000:2.0:1789445892.587610:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256da3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445892.587612:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722131712 00010000:00010000:2.0:1789445892.587615:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bee00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445892.587620:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256da3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.587628:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256da3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.587645:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe8e97a400) 00010000:00010000:2.0:1789445892.587648:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445892.587654:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256da3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.587661:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256da3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445892.587680:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 192 00000100:00100000:3.0:1789445892.587691:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+31:11103:x1876369722131712:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:3.0:1789445892.587720:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445892.587737:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256daa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e01 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.587799:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256daa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e01 expref: 32 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.587813:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256daa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e01 expref: 32 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.587832:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe8e97a400) 00010000:00010000:3.0:1789445892.587834:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789445892.587837:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989400, rc 0) 00000100:00100000:3.0:1789445892.587898:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+32:11103:x1876369722131712:12345-192.168.206.59@tcp:101:bash.0 Request processed in 209us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445892.587906:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 192 00000100:00100000:1.0:1789445892.593301:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445892.593380:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722131840 00000100:00100000:0.0:1789445892.593403:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722131840 00000100:00100000:0.0:1789445892.593460:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 58 00000100:00100000:0.0:1789445892.593470:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:11103:x1876369722131840:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:0.0:1789445892.593487:0:11692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445892.593507:0:11692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d47256db1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e08 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789445892.593539:0:11692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa8c702, atime: 0x6aa8c700, ctime: 0x6aa8c702, blocks: 0xb 00010000:00010000:0.0:1789445892.593559:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=330s v=(0 0) 00010000:00010000:0.0:1789445892.593564:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445892.593571:0:11692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d47256db1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e08 expref: 8 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.593588:0:11692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d47256db1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e08 expref: 8 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.593600:0:11692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906400, rc 0) 00000100:00100000:0.0:1789445892.593660:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:11103:x1876369722131840:12345-192.168.206.59@tcp:101:bash.0 Request processed in 191us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445892.593667:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 58 00000100:00100000:1.0:1789445892.603695:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445892.605311:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722131968 00000100:00100000:0.0:1789445892.605323:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722131968 00002000:00010000:0.0:1789445892.605374:0:6689:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1789445892.605379:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afebf624a80 with x1876369722131968 ext(0->18446744073709551615) 00002000:00010000:0.0:1789445892.605390:0:6689:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afebf624a80. 00000100:00100000:0.0:1789445892.605468:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 5 00000100:00100000:0.0:1789445892.605477:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2374:x1876369722131968:12345-192.168.206.59@tcp:10:bash.0 00002000:00010000:0.0:1789445892.605746:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789445892.605750:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789445890 -> 1789445892 00002000:00010000:0.0:1789445892.605753:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789445888 -> 1789445888 00002000:00010000:0.0:1789445892.605755:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789445890 -> 1789445892 00002000:00010000:0.0:1789445892.605757:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789445892.605823:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:2374:x1876369722131968:12345-192.168.206.59@tcp:10:bash.0 Request processed in 346us (2135us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789445892.605831:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 5 00002000:00010000:0.0:1789445892.605835:0:6689:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1789445892.605838:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afebf624a80 with x1876369722131968 ext(0->18446744073709551615) 00002000:00010000:0.0:1789445892.605842:0:6689:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afebf624a80. 00000100:00100000:1.0:1789445892.644577:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445892.644622:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445892.644659:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445892.644739:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722132224 00000100:00100000:3.0:1789445892.644749:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722132224 00000100:00100000:3.0:1789445892.644809:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 87 00000100:00100000:3.0:1789445892.644819:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2375:x1876369722132224:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445892.644878:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2375:x1876369722132224:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 61us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445892.644885:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 87 00000100:00100000:0.0:1789445892.644951:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722132096 00000100:00100000:0.0:1789445892.644956:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722132096 00000100:00100000:0.0:1789445892.644993:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 293 00000100:00100000:0.0:1789445892.645001:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2375:x1876369722132096:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445892.645066:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2375:x1876369722132096:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 45us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445892.645072:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 293 00000100:00080000:1.0:1789445892.645299:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789445892.645697:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722132352 00000100:00100000:2.0:1789445892.645704:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722132352 00000100:00100000:2.0:1789445892.645759:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 148 00000100:00100000:2.0:1789445892.645768:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2375:x1876369722132352:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445892.645821:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:338e572d-37d9-47c3-87b6-4735cd889844+5:2375:x1876369722132352:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 54us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445892.645827:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 148 00000100:00080000:1.0:1789445892.647156:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789445892.696900:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445892.696991:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722132480 00000100:00100000:0.0:1789445892.696999:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722132480 00000100:00100000:0.0:1789445892.697081:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 193 00000100:00100000:0.0:1789445892.697090:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+32:11583:x1876369722132480:12345-192.168.206.59@tcp:34:lfs.0 00010000:00010000:0.0:1789445892.697160:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256db8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697176:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256db8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697200:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256db8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697215:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256dbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697222:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256dbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697228:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256dbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697435:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256dc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697443:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697450:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789445892.697488:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697500:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256db8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697505:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256db8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697512:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256db8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697529:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445892.697534:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256db8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697542:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256db8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697555:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:0.0:1789445892.697558:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445892.697563:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256db8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697569:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906000/0xc1b37c4d47256db8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697581:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256dbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697587:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256dbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697593:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256dbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697598:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445892.697601:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256dbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697606:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256dbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697621:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe98961b00) 00010000:00010000:0.0:1789445892.697624:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445892.697627:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256dbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697632:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d47256dbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697651:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697657:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256dc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697662:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697667:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445892.697670:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697676:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256dc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697683:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe8e97a400) 00010000:00010000:0.0:1789445892.697685:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445892.697688:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256dc6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.697693:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256dc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445892.697769:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+32:11583:x1876369722132480:12345-192.168.206.59@tcp:34:lfs.0 Request processed in 679us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445892.697776:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 193 00000100:00100000:0.0:1789445892.776107:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445892.776398:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722132736 00000100:00100000:2.0:1789445892.776422:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722132736 00000100:00100000:2.0:1789445892.776485:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 194 00000100:00100000:2.0:1789445892.776496:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+32:11586:x1876369722132736:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:2.0:1789445892.776531:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445892.776550:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256dcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e0f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.776624:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256dd4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.776638:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256dd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.776651:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256dd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.776677:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ddb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.776684:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ddb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.776691:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ddb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.776916:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256de2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.776925:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256de2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.776931:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256de2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445892.776939:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789445892.777025:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256dd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.777032:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256dd4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.777039:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256dd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.777074:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445892.777078:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256dd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.777085:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256dd4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.777095:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:2.0:1789445892.777098:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445892.777103:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256dd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.777108:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256dd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.777119:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ddb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.777125:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ddb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.777130:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ddb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.777134:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445892.777156:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ddb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.777163:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ddb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.777170:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe90eac900) 00010000:00010000:2.0:1789445892.777173:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445892.777176:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ddb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.777182:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ddb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.777223:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256dcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e0f expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.777234:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256de2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e0f expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.777241:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe8e97a400) 00010000:00010000:2.0:1789445892.777243:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789445892.777246:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bee00, rc 0) 00000100:00100000:2.0:1789445892.777324:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+34:11586:x1876369722132736:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 830us (1225us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1789445892.777344:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 194 00000100:00100000:1.0:1789445892.781588:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445892.781832:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722132864 00000100:00100000:0.0:1789445892.781842:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722132864 00000100:00100000:0.0:1789445892.781905:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 195 00000100:00100000:0.0:1789445892.781916:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+34:11586:x1876369722132864:12345-192.168.206.59@tcp:54:lfs.0 00010000:00010000:0.0:1789445892.781985:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256df0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.782002:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d95 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dfa expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.782012:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256df0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.782082:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dfa expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.782097:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d95 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dfa expref: 34 pid: 5842 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445892.782111:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf669f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742048000:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445892.782208:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87ddeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789445892.786447:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf669f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742048000:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789445892.786505:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256df0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445892.789100:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445892.789447:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722133120 00000100:00100000:0.0:1789445892.789458:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722133120 00000100:00100000:0.0:1789445892.789528:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 52 00000100:00100000:0.0:1789445892.789541:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+35:5628:x1876369722133120:12345-192.168.206.59@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789445892.789944:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+36:5628:x1876369722133120:12345-192.168.206.59@tcp:35:ldlm_bl.0 Request processed in 403us (850us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789445892.789954:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 52 00000100:00100000:1.0:1789445892.797966:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445892.798082:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722133248 00000100:00100000:0.0:1789445892.798092:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722133248 00010000:00010000:0.0:1789445892.798252:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d95 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dfa expref: 36 pid: 5842 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445892.798360:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 75 00000100:00100000:0.0:1789445892.798371:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf625880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+36:2375:x1876369722133248:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789445892.798385:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445892.798393:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d95 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dfa expref: 36 pid: 5842 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.798406:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dfa expref: 36 pid: 5842 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.798427:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256d95 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dfa expref: 36 pid: 5842 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.798461:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe8e97a400) 00010000:00010000:0.0:1789445892.798466:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256df0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.798476:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256df0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.798484:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256df0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445892.798516:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445892.798575:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf625880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+35:2375:x1876369722133248:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 205us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445892.798583:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 75 00010000:00010000:3.0:1789445892.800584:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256df0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.800604:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256df0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.800666:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256df0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.800674:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256df0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.800682:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256df0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.800689:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445892.800693:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256df0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.800702:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256df0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.800722:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe8e97a400) 00010000:00010000:3.0:1789445892.800726:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789445892.800731:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256df0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.800739:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256df0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445892.800852:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+34:11586:x1876369722132864:12345-192.168.206.59@tcp:54:lfs.0 Request processed in 18932us (19268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445892.800862:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 195 00000100:00100000:1.0:1789445892.810389:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445892.810593:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722133504 00000100:00100000:3.0:1789445892.810604:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722133504 00000100:00100000:3.0:1789445892.810661:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 53 00000100:00100000:3.0:1789445892.810696:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+34:11586:x1876369722133504:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:3.0:1789445892.810934:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+35:11586:x1876369722133504:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 241us (554us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789445892.810943:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 53 00010000:00010000:0.0:1789445892.830815:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445892.934817:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445892.934913:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722133760 00000100:00100000:2.0:1789445892.934924:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722133760 00000100:00100000:2.0:1789445892.934989:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 196 00000100:00100000:2.0:1789445892.934999:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+35:11597:x1876369722133760:12345-192.168.206.59@tcp:101:cat.0 00010000:00010000:2.0:1789445892.935037:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445892.935100:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256df7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e16 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935181:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256dfe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935195:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256dfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935206:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256dfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935219:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935226:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935234:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935486:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256e0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935495:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935503:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445892.935512:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789445892.935606:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256dfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935614:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256dfe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935620:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256dfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935626:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445892.935630:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256dfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935637:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256dfe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935649:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:2.0:1789445892.935652:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445892.935657:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256dfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935663:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256dfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935674:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935681:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935687:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935692:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445892.935700:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935707:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935714:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe90eac900) 00010000:00010000:2.0:1789445892.935717:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445892.935720:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935726:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935764:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256df7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e16 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935777:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256e0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e16 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.935785:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe8e97a400) 00010000:00010000:2.0:1789445892.935788:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789445892.935790:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bfc00, rc 0) 00000100:00100000:2.0:1789445892.935854:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+37:11597:x1876369722133760:12345-192.168.206.59@tcp:101:cat.0 Request processed in 856us (1045us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789445892.935862:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 196 00000100:00100000:1.0:1789445892.940731:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445892.941308:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722134016 00000100:00100000:2.0:1789445892.941319:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722134016 00000100:00100000:2.0:1789445892.941386:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 54 00000100:00100000:2.0:1789445892.941396:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+37:11597:x1876369722134016:12345-192.168.206.59@tcp:35:cat.0 00000100:00100000:2.0:1789445892.942198:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+38:11597:x1876369722134016:12345-192.168.206.59@tcp:35:cat.0 Request processed in 801us (1471us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1789445892.942208:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 54 00000100:00100000:1.0:1789445892.973695:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445892.973773:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722134272 00000100:00100000:3.0:1789445892.973783:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722134272 00000100:00100000:3.0:1789445892.973846:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 197 00000100:00100000:3.0:1789445892.973856:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+38:11598:x1876369722134272:12345-192.168.206.59@tcp:36:rm.0 00010000:00010000:3.0:1789445892.973911:0:8204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789445892.973935:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256e0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e16 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.973957:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256de2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e0f expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.973970:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256daa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e01 expref: 36 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.973979:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe8e97a400) 00010000:00010000:3.0:1789445892.973989:0:8204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789445892.974007:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256e1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.974018:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256e1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.974027:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256e1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.974121:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47256e21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.974130:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47256e21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.974147:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47256e21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.974395:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256e28 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.974404:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256e28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.974411:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256e28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789445892.974930:0:8204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1789445892.974940:0:8204:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 330996894083ns, next at 331996891968ns, rc = 0 00010000:00010000:3.0:1789445892.974992:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256e2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975003:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256e2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975011:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256e2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975020:0:8204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256e2f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975037:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256e2f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975086:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256e2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975100:0:8204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789445892.975121:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256e28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975127:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256e28 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975133:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256e28 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975139:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445892.975143:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256e28 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975151:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256e28 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975161:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe8e97a700) 00010000:00010000:3.0:1789445892.975164:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789445892.975168:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256e28 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975174:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256e28 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975190:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256e1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975201:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256e1a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975207:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256e1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975212:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445892.975216:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256e1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975222:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256e1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975229:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:3.0:1789445892.975232:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445892.975235:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256e1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.975241:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256e1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789445892.975250:0:8204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000905ff2bc reply state 00000000f9bf102f transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47256e21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445892.975258:0:8204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789445892.975339:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+37:11598:x1876369722134272:12345-192.168.206.59@tcp:36:rm.0 Request processed in 1472us (1640us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789445892.975347:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 197 00010000:00010000:2.0:1789445892.975584:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445892.975591:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256e2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.975598:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989600 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445892.975601:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256e2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.975608:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256e2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.975617:0:8445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9afe8e97a700) 00010000:00010000:2.0:1789445892.975620:0:8445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789445892.975623:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256e2f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.975629:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256e2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445892.975644:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445892.975645:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445892.975647:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445892.978689:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47256e21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.978725:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47256e21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.978734:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47256e21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.978741:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445892.978746:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47256e21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.978755:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47256e21 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.978771:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe8e97ab00) 00010000:00010000:3.0:1789445892.978775:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445892.978780:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47256e21 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445892.978788:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47256e21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445893.062916:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445893.063008:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722134528 00000100:00100000:2.0:1789445893.063019:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722134528 00000100:00100000:2.0:1789445893.063117:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 198 00000100:00100000:2.0:1789445893.063127:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+36:11604:x1876369722134528:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:2.0:1789445893.063151:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445893.063185:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256e36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e1d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.063293:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.063308:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.063321:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.063344:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256e44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.063351:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256e44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.063358:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256e44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789445893.063865:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789445893.064009:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256e4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.064019:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256e4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.064027:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256e4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.064084:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.064103:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e3d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.064109:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.064115:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445893.064119:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.064127:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.064138:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:2.0:1789445893.064141:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445893.064146:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.064152:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256e3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789445893.064165:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000878542a5 reply state 00000000ac06af94 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256e44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445893.064173:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789445893.064199:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256e36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e1d expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.064213:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256e4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e1d expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.064230:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:2.0:1789445893.064233:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789445893.064235:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf600, rc 0) 00000100:00100000:2.0:1789445893.064289:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+39:11604:x1876369722134528:12345-192.168.206.59@tcp:101:bash.0 Request processed in 1164us (1382us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789445893.064296:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 198 00010000:00010000:2.0:1789445893.069100:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256e44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.069127:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256e44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.069135:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256e44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.069151:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445893.069156:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256e44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.069164:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256e44 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.069181:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe90eac900) 00010000:00010000:2.0:1789445893.069184:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445893.069189:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256e44 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.069195:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256e44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445893.070662:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445893.070751:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722134656 00000100:00100000:3.0:1789445893.070760:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722134656 00000100:00100000:3.0:1789445893.070814:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 59 00000100:00100000:3.0:1789445893.070823:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2374:x1876369722134656:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:3.0:1789445893.070839:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445893.070855:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045be24f9/0xc1b37c4d47256e59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e24 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789445893.070897:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789445893.070916:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=331s v=(0 0) 00010000:00010000:3.0:1789445893.070920:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445893.070929:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045be24f9/0xc1b37c4d47256e59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e24 expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.070947:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045be24f9/0xc1b37c4d47256e59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e24 expref: 6 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.070959:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e988000, rc 0) 00000100:00100000:3.0:1789445893.071019:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2374:x1876369722134656:12345-192.168.206.59@tcp:101:bash.0 Request processed in 196us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445893.071025:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 59 00000100:00100000:1.0:1789445893.076629:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445893.076722:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722134784 00000100:00100000:3.0:1789445893.076732:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722134784 00000100:00100000:3.0:1789445893.076780:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 60 00000100:00100000:3.0:1789445893.076790:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:11604:x1876369722134784:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:3.0:1789445893.076806:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445893.076825:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5aa6e92/0xc1b37c4d47256e60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e2b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.076860:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000045be24f9/0xc1b37c4d47256e59 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e24 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.076886:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445893.076891:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445893.076897:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5aa6e92/0xc1b37c4d47256e60 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e2b expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.076929:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000045be24f9/0xc1b37c4d47256e59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e24 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.076943:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000045be24f9/0xc1b37c4d47256e59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e24 expref: 7 pid: 6684 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445893.076957:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1876369742048128:192.168.206.59@tcp:104: 00000100:00100000:3.0:1789445893.077088:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d2540 going to sleep for 11 seconds 00000100:00100000:3.0:1789445893.096539:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1876369742048128:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789445893.096578:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5aa6e92/0xc1b37c4d47256e60 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e2b expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.096599:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989000, rc 0) 00000100:00100000:3.0:1789445893.096663:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:11604:x1876369722134784:12345-192.168.206.59@tcp:101:bash.0 Request processed in 19874us (20042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445893.096671:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 60 00000100:00100000:1.0:1789445893.101760:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445893.101862:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722134912 00000100:00100000:2.0:1789445893.101871:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722134912 00010000:00010000:2.0:1789445893.101911:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000045be24f9/0xc1b37c4d47256e59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e24 expref: 7 pid: 6684 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445893.101956:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 76 00000100:00100000:2.0:1789445893.101967:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe87d85450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2374:x1876369722134912:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445893.101982:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445893.102013:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000045be24f9/0xc1b37c4d47256e59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e24 expref: 7 pid: 6684 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.102039:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000045be24f9/0xc1b37c4d47256e59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e24 expref: 7 pid: 6684 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.102102:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045be24f9/0xc1b37c4d47256e59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e24 expref: 7 pid: 6684 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.102130:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445893.102414:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445893.102426:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5aa6e92/0xc1b37c4d47256e60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e2b expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.102438:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5aa6e92/0xc1b37c4d47256e60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e2b expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.102558:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b5aa6e92/0xc1b37c4d47256e60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e2b expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445893.102586:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5826:1876369742048256:192.168.206.59@tcp:105: 00000100:00100000:3.0:1789445893.102663:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d2540 going to sleep for 11 seconds 00000100:00100000:3.0:1789445893.118760:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5826:1876369742048256:192.168.206.59@tcp:105: 00010000:00010000:3.0:1789445893.118788:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445893.118844:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe87d85450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2374:x1876369722134912:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 16879us (17091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445893.118856:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 76 00000100:00100000:1.0:1789445893.120752:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445893.120848:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722135168 00000100:00100000:0.0:1789445893.120856:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722135168 00000100:00100000:0.0:1789445893.120910:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 55 00000100:00100000:0.0:1789445893.120920:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+38:11604:x1876369722135168:12345-192.168.206.59@tcp:35:bash.0 00000100:00100000:0.0:1789445893.121300:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+39:11604:x1876369722135168:12345-192.168.206.59@tcp:35:bash.0 Request processed in 381us (556us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789445893.121308:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 55 00000100:00100000:1.0:1789445893.466492:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445893.466577:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722135296 00000100:00100000:3.0:1789445893.466587:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722135296 00000100:00100000:3.0:1789445893.466650:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 199 00000100:00100000:3.0:1789445893.466660:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+39:11620:x1876369722135296:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445893.466683:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445893.466703:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256e67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e32 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.466766:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256e6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.466778:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256e6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.466789:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256e6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445893.466820:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789445893.466823:0:8204:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789445893.466858:0:8204:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256e6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.466882:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47256e67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e32 expref: 41 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.466900:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256e6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e32 expref: 40 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.466909:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:3.0:1789445893.466912:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789445893.466916:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989400, rc 0) 00000100:00100000:3.0:1789445893.466975:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+40:11620:x1876369722135296:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 317us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445893.466983:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 199 00000100:00100000:1.0:1789445893.470937:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445893.471097:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722135552 00000100:00100000:3.0:1789445893.471110:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722135552 00000100:00100000:3.0:1789445893.471194:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 200 00000100:00100000:3.0:1789445893.471207:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+40:11620:x1876369722135552:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445893.471236:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445893.471267:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256e75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e39 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.471427:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d47256e7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.471444:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d47256e7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.471473:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d47256e7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445893.471488:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789445893.471652:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256e75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e39 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.471805:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d47256e7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e39 expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.471816:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:3.0:1789445893.471819:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789445893.471824:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989200, rc 0) 00000100:00100000:3.0:1789445893.471912:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+42:11620:x1876369722135552:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 709us (991us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789445893.471921:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 200 00000100:00100000:1.0:1789445893.474116:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445893.474223:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722135680 00000100:00100000:2.0:1789445893.474239:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722135680 00000100:00100000:2.0:1789445893.474338:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 14 00000100:00100000:2.0:1789445893.474350:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead814000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+42:2374:x1876369722135680:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445893.474367:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445893.474394:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d47256e7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e39 expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445893.474410:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00010000:00010000:2.0:1789445893.474425:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:2.0:1789445893.474436:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445893.474505:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead814000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+41:2374:x1876369722135680:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 157us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445893.474513:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 14 00000100:00100000:3.0:1789445893.474862:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722135936 00000100:00100000:3.0:1789445893.474872:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722135936 00000100:00100000:3.0:1789445893.474931:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 201 00000100:00100000:3.0:1789445893.474943:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+41:11620:x1876369722135936:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445893.474971:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445893.474993:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256e8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e40 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.475163:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47256e91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.475193:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47256e91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.475206:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47256e91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445893.475222:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789445893.475378:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256e8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e40 expref: 44 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.475394:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47256e91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e40 expref: 43 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.475400:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:3.0:1789445893.475403:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789445893.475405:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e988000, rc 0) 00000100:00100000:3.0:1789445893.475469:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+43:11620:x1876369722135936:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 529us (1068us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789445893.475480:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 201 00000100:00100000:1.0:1789445893.479581:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445893.479927:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722136064 00000100:00100000:3.0:1789445893.479940:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722136064 00000100:00100000:3.0:1789445893.480013:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 61 00000100:00100000:3.0:1789445893.480026:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+6:2377:x1876369722136064:12345-192.168.206.59@tcp:1:lfs.0 00010000:00010000:3.0:1789445893.480116:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be853971/0xc1b37c4d47256e9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.480286:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5aa6e92/0xc1b37c4d47256e60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e2b expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.480316:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445893.480322:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789445893.480344:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be853971/0xc1b37c4d47256e9f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.480388:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b5aa6e92/0xc1b37c4d47256e60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e2b expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.480403:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b5aa6e92/0xc1b37c4d47256e60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e2b expref: 6 pid: 6682 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445893.480421:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876369742048384:192.168.206.59@tcp:104: 00000100:00100000:3.0:1789445893.480626:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445893.484316:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445893.484471:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722136192 00000100:00100000:0.0:1789445893.484487:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722136192 00000100:00100000:3.0:1789445893.484490:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876369742048384:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789445893.484530:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000be853971/0xc1b37c4d47256e9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1789445893.484554:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9afead817480 x1876369722136192/t0(0) o4->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:19/0 lens 504/0 e 0 to 0 dl 1789445904 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789445893.484567:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afead817480 with x1876369722136192 ext(0->8) 00010000:00010000:0.0:1789445893.484603:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b5aa6e92/0xc1b37c4d47256e60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e2b expref: 7 pid: 6682 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445893.484622:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b5aa6e92/0xc1b37c4d47256e60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e2b expref: 7 pid: 6682 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789445893.484630:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9afead817480 00000100:00100000:0.0:1789445893.484669:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 3 00000100:00100000:0.0:1789445893.484678:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2375:x1876369722136192:12345-192.168.206.59@tcp:4:lfs.0 00000100:00100000:0.0:1789445893.485309:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:2375:x1876369722136192:12345-192.168.206.59@tcp:4:lfs.0 Request processed in 629us (1003us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789445893.485320:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 3 00002000:00100000:0.0:1789445893.485340:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9afead817480 x1876369722136192/t4294967308(0) o4->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:19/0 lens 504/448 e 0 to 0 dl 1789445904 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789445893.485350:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afead817480 with x1876369722136192 ext(0->8) 00010000:00010000:0.0:1789445893.485358:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b5aa6e92/0xc1b37c4d47256e60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e2b expref: 9 pid: 6682 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445893.485371:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b5aa6e92/0xc1b37c4d47256e60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e2b expref: 9 pid: 6682 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789445893.485378:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9afead817480 00000100:00100000:1.0:1789445893.505091:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445893.505694:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722136320 00000100:00100000:3.0:1789445893.505719:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722136320 00010000:00010000:3.0:1789445893.505766:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b5aa6e92/0xc1b37c4d47256e60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e2b expref: 9 pid: 6682 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445893.505816:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 77 00000100:00100000:3.0:1789445893.505827:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead816680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:2374:x1876369722136320:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445893.505858:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789445893.505880:0:7627:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789445893.505883:0:7627:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789445893 00002000:00010000:3.0:1789445893.505885:0:7627:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789445893 00002000:00010000:3.0:1789445893.505888:0:7627:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789445893 00010000:00010000:3.0:1789445893.505894:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b5aa6e92/0xc1b37c4d47256e60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e2b expref: 9 pid: 6682 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.505909:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b5aa6e92/0xc1b37c4d47256e60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e2b expref: 9 pid: 6682 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.506300:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5aa6e92/0xc1b37c4d47256e60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e2b expref: 9 pid: 6682 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.506322:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789445893.506338:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789445893.506344:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be853971/0xc1b37c4d47256e9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.506356:0:7627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be853971/0xc1b37c4d47256e9f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.506397:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445893.506771:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead816680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2374:x1876369722136320:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 874us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445893.506782:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 77 00010000:00010000:2.0:1789445893.506877:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000be853971/0xc1b37c4d47256e9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.506890:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be853971/0xc1b37c4d47256e9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.506935:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be853971/0xc1b37c4d47256e9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.506945:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be853971/0xc1b37c4d47256e9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.506966:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be853971/0xc1b37c4d47256e9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.506974:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988c00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445893.506979:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be853971/0xc1b37c4d47256e9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.506989:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be853971/0xc1b37c4d47256e9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.507004:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be853971/0xc1b37c4d47256e9f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.507014:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be853971/0xc1b37c4d47256e9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445893.507119:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2377:x1876369722136064:12345-192.168.206.59@tcp:1:lfs.0 Request processed in 27095us (27558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445893.507129:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 61 00000100:00100000:2.0:1789445893.516969:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445893.517068:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722136576 00000100:00100000:3.0:1789445893.517077:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722136576 00000100:00100000:3.0:1789445893.517124:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 56 00000100:00100000:3.0:1789445893.517146:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c03050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+43:11620:x1876369722136576:12345-192.168.206.59@tcp:35:lfs.0 00000004:00010000:3.0:1789445893.517205:0:11955:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47256e91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e40 expref: 43 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789445893.517449:0:11955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1789445893.517493:0:11955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1789445893.518248:0:11955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1789445893.518311:0:11955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256ea6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.518339:0:11955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256e4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e1d expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.518348:0:11955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256ea6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.518380:0:11955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256e4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e1d expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.518394:0:11955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256e4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e1d expref: 47 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445893.518407:0:11955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8ec000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11955:1876369742048512:192.168.206.59@tcp:104: 00000100:00100000:3.0:1789445893.518477:0:11955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeba1d2240 going to sleep for 11 seconds 00000100:00100000:1.0:1789445893.531142:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445893.531273:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722136704 00000100:00100000:0.0:1789445893.531284:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722136704 00010000:00010000:0.0:1789445893.531341:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256e4b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e1d expref: 48 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445893.531411:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 78 00000100:00100000:0.0:1789445893.531422:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+48:2375:x1876369722136704:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789445893.531439:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445893.531447:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256e4b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e1d expref: 48 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445893.531461:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256e4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e1d expref: 48 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445893.531484:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:0.0:1789445893.531490:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256ea6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445893.531500:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256ea6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445893.531508:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256ea6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445893.531527:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445893.531587:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+48:2375:x1876369722136704:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 155us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445893.531595:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 78 00010000:00010000:3.0:1789445893.532303:0:11955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256e4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e1d expref: 47 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445893.532346:0:11955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8ec000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11955:1876369742048512:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789445893.532366:0:11955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256ea6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.532375:0:11955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256ea6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.532382:0:11955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256ea6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789445893.532508:0:11955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1789445893.532731:0:11955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1789445893.532842:0:11955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afead8ec000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11955:1876369742048640:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1789445893.532896:0:11955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445893.533361:0:11955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91abcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789445893.533677:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742048640 00000100:00100000:0.0:1789445893.533685:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742048640 00000100:00100000:0.0:1789445893.533752:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789445893.533762:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11955:x1876369742048640:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1789445893.533855:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11955:x1876369742048640:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 94us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445893.533862:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789445893.533946:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445893.535306:0:11955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afead8ec000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11955:1876369742048640:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1789445893.537125:0:11955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1789445893.537220:0:11955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11955:1876369742048768:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789445893.537284:0:11955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445893.537400:0:11955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87dd6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789445893.539614:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742048768 00000100:00100000:1.0:1789445893.539631:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742048768 00000100:00100000:1.0:1789445893.539704:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789445893.539717:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11955:x1876369742048768:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789445893.540029:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:11955:x1876369742048768:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 314us (2743us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789445893.540038:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789445893.540474:0:11955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11955:1876369742048768:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1789445893.540577:0:11955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1789445893.540632:0:11955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256ea6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.540644:0:11955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256ea6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.540653:0:11955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256ea6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.540659:0:11955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445893.540663:0:11955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256ea6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.540672:0:11955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256ea6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.540688:0:11955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:2.0:1789445893.540691:0:11955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789445893.540972:0:11955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256ea6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.540981:0:11955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47256ea6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789445893.541219:0:11955:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789445893.541366:0:11955:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789445893.541379:0:11955:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331563332882ns, next at 332563330883ns, rc = 0 00000001:00080000:2.0:1789445893.541386:0:11955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1789445893.541425:0:11955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:2.0:1789445893.541429:0:11955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789445893.541443:0:11955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47256e91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e40 expref: 51 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445893.541581:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c03050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+50:11620:x1876369722136576:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 24448us (24619us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1789445893.541592:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 56 00000020:00080000:2.0:1789445893.541597:0:11955:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789445893.554415:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445893.554519:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722136832 00000100:00100000:2.0:1789445893.554530:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722136832 00000100:00100000:2.0:1789445893.554634:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 202 00000100:00100000:2.0:1789445893.554646:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+50:11620:x1876369722136832:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:2.0:1789445893.554671:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445893.554703:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256ead lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e47 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.554767:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256ead lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e47 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.554785:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256ead lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e47 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.554806:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:2.0:1789445893.554810:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789445893.554826:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57be800, rc 0) 00000100:00100000:2.0:1789445893.554891:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+51:11620:x1876369722136832:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 247us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445893.554899:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 202 00000100:00100000:1.0:1789445893.565802:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445893.569664:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722137088 00000100:00100000:3.0:1789445893.569680:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722137088 00000100:00100000:2.0:1789445893.569971:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 57 00000100:00100000:2.0:1789445893.569998:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+51:11620:x1876369722137088:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:2.0:1789445893.570321:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+52:11620:x1876369722137088:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 323us (4528us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789445893.570339:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 57 00000100:00100000:0.0:1789445893.713769:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445893.713858:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722137216 00000100:00100000:3.0:1789445893.713868:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722137216 00000100:00100000:3.0:1789445893.713928:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 203 00000100:00100000:3.0:1789445893.713937:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+52:11630:x1876369722137216:12345-192.168.206.59@tcp:34:lfs.0 00010000:00010000:3.0:1789445893.714009:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256eb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714026:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714095:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714110:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256ebb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714118:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714125:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714282:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256ec2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714291:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714298:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789445893.714350:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714363:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714370:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256eb4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714377:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714393:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445893.714397:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714404:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256eb4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714417:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:3.0:1789445893.714420:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445893.714425:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256eb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714431:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256eb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714445:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714451:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256ebb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714457:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256ebb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714461:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445893.714464:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256ebb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714470:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256ebb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714488:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe8e97a300) 00010000:00010000:3.0:1789445893.714490:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445893.714494:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256ebb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714500:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256ebb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714514:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714521:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256ec2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714527:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714532:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445893.714535:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714541:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714548:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:3.0:1789445893.714551:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445893.714554:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256ec2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.714559:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256ec2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445893.714646:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+52:11630:x1876369722137216:12345-192.168.206.59@tcp:34:lfs.0 Request processed in 708us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445893.714654:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 203 00000100:00100000:3.0:1789445893.763014:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445893.763159:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722137472 00000100:00100000:2.0:1789445893.763170:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722137472 00000100:00100000:2.0:1789445893.763223:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 204 00000100:00100000:2.0:1789445893.763232:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead8ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+52:11633:x1876369722137472:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:2.0:1789445893.763250:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445893.763270:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256ec9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e4e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.763372:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256ed0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.763386:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.763396:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.763410:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ed7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.763416:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.763422:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.763537:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ede lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.763545:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ede lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.763552:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ede lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445893.763562:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789445893.763645:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.763652:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256ed0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.763658:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.764031:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445893.764036:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.764083:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256ed0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.764097:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:2.0:1789445893.764100:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445893.764104:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256ed0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.764120:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256ed0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.764135:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.764198:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ed7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.764205:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.764210:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445893.764213:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.764219:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ed7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.764225:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe90eac900) 00010000:00010000:2.0:1789445893.764228:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789445893.764230:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ed7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.764235:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256ed7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.764277:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256ec9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e4e expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.764289:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ede lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e4e expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.764301:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:2.0:1789445893.764303:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789445893.764305:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bee00, rc 0) 00000100:00100000:2.0:1789445893.764580:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead8ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+54:11633:x1876369722137472:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 1348us (1575us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789445893.764588:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 204 00000100:00100000:2.0:1789445893.769871:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445893.770811:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722137600 00000100:00100000:3.0:1789445893.770822:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722137600 00000100:00100000:3.0:1789445893.770885:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 205 00000100:00100000:3.0:1789445893.770896:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+54:11633:x1876369722137600:12345-192.168.206.59@tcp:54:lfs.0 00010000:00010000:3.0:1789445893.770965:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256eec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.770982:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256eec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.770994:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256eec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.771020:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256eec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.771026:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256eec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.771033:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256eec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.771039:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445893.771076:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256eec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.771102:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256eec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.771114:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:3.0:1789445893.771117:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789445893.771123:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256eec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.771129:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256eec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445893.772239:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+54:11633:x1876369722137600:12345-192.168.206.59@tcp:54:lfs.0 Request processed in 1341us (2372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445893.772248:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 205 00000100:00100000:0.0:1789445893.778995:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445893.780782:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722137856 00000100:00100000:1.0:1789445893.780799:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722137856 00000100:00100000:1.0:1789445893.780907:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 58 00000100:00100000:1.0:1789445893.780919:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+54:11633:x1876369722137856:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:1.0:1789445893.781407:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:11633:x1876369722137856:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 489us (2419us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789445893.781415:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 58 00010000:00010000:1.0:1789445893.850296:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445893.877123:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445893.877657:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722138112 00000100:00100000:2.0:1789445893.877866:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722138112 00000100:00100000:2.0:1789445893.877931:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 206 00000100:00100000:2.0:1789445893.877940:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:11643:x1876369722138112:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:2.0:1789445893.877962:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445893.877965:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789445893.877989:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256e6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e32 expref: 55 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.878008:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:2.0:1789445893.878013:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789445893.878027:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256ef3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e55 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.878220:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256efa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.878233:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ede lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e4e expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.878258:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256efa lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.878287:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ede lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e4e expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.878300:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ede lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e4e expref: 55 pid: 5841 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445893.878314:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742048896:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445893.878471:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91474240 going to sleep for 11 seconds 00000100:00100000:2.0:1789445893.883092:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742048896:192.168.206.59@tcp:104: 00010000:00010000:2.0:1789445893.883149:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256efa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445893.885783:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445893.886121:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722138240 00000100:00100000:3.0:1789445893.886138:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722138240 00010000:00010000:3.0:1789445893.886177:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ede lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e4e expref: 56 pid: 5841 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445893.886221:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 79 00000100:00100000:3.0:1789445893.886232:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+56:2374:x1876369722138240:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445893.886247:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445893.886255:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ede lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e4e expref: 56 pid: 5841 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.886268:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ede lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e4e expref: 56 pid: 5841 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.886314:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ede lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e4e expref: 56 pid: 5841 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.886500:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:3.0:1789445893.886507:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256efa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.886518:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256efa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.886525:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256efa lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445893.886556:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445893.886621:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:2374:x1876369722138240:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 390us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445893.886629:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 79 00010000:00010000:2.0:1789445893.887119:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256efa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.887139:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256efa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445893.887161:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789445893.887357:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256ef3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e55 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.887375:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256efa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e55 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.887399:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:2.0:1789445893.887402:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789445893.887404:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57be400, rc 0) 00000100:00100000:2.0:1789445893.887446:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:11643:x1876369722138112:12345-192.168.206.59@tcp:101:bash.0 Request processed in 9506us (10331us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789445893.887454:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 206 00000100:00100000:0.0:1789445893.892744:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445893.892816:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722138496 00000100:00100000:1.0:1789445893.892828:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722138496 00000100:00100000:1.0:1789445893.892937:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 207 00000100:00100000:1.0:1789445893.892948:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+55:11643:x1876369722138496:12345-192.168.206.59@tcp:36:bash.0 00010000:00010000:1.0:1789445893.893272:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256f08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445893.893314:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256f08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445893.893340:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256f08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789445893.893411:0:8204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1789445893.893435:0:8204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb5acf4b reply state 00000000debc21ae transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256f08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445893.893444:0:8204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789445893.893537:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+58:11643:x1876369722138496:12345-192.168.206.59@tcp:36:bash.0 Request processed in 591us (803us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789445893.893552:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 207 00000020:00080000:1.0:1789445893.893556:0:8204:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789445893.897300:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00010000:00010000:1.0:1789445893.897413:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256f08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445893.897428:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256f08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445893.897436:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256f08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445893.897442:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6fe00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445893.897447:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256f08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445893.897454:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256f08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445893.897488:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:1.0:1789445893.897491:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445893.897497:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256f08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445893.897503:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fe00/0xc1b37c4d47256f08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445893.897524:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722138624 00000100:00100000:2.0:1789445893.897536:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722138624 00000100:00100000:2.0:1789445893.897601:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 208 00000100:00100000:2.0:1789445893.897612:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+57:11643:x1876369722138624:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:2.0:1789445893.897634:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445893.897652:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256f0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e5c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.897745:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.897759:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256efa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e55 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.897768:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f16 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.897805:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256efa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e55 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.897820:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256efa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e55 expref: 58 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445893.897843:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742049024:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445893.899624:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91474d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789445893.901541:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742049024:192.168.206.59@tcp:104: 00010000:00010000:2.0:1789445893.901631:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445893.902757:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445893.902844:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722138752 00000100:00100000:0.0:1789445893.902854:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722138752 00010000:00010000:0.0:1789445893.902898:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256efa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e55 expref: 59 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445893.902979:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 80 00000100:00100000:0.0:1789445893.902991:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:2375:x1876369722138752:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789445893.903007:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445893.903015:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256efa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e55 expref: 59 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445893.903029:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256efa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e55 expref: 59 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445893.903097:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256efa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e55 expref: 59 pid: 5840 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445893.903114:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:0.0:1789445893.903119:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445893.903135:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445893.903144:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f16 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445893.903169:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445893.903235:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+58:2375:x1876369722138752:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 246us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445893.903242:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 80 00010000:00010000:2.0:1789445893.903320:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.903337:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445893.903382:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789445893.903386:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789445893.903408:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.903441:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256f0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e5c expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.903456:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e5c expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445893.903463:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:2.0:1789445893.903466:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789445893.903468:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf600, rc 0) 00000100:00100000:2.0:1789445893.903495:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+57:11643:x1876369722138624:12345-192.168.206.59@tcp:101:bash.0 Request processed in 5886us (6207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445893.903509:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 208 00000100:00100000:0.0:1789445893.911354:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445893.911625:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722139008 00000100:00100000:1.0:1789445893.911635:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722139008 00000100:00100000:1.0:1789445893.911710:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 59 00000100:00100000:1.0:1789445893.911721:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+57:11643:x1876369722139008:12345-192.168.206.59@tcp:35:bash.0 00000100:00100000:1.0:1789445893.912273:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+58:11643:x1876369722139008:12345-192.168.206.59@tcp:35:bash.0 Request processed in 550us (924us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1789445893.912284:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 59 00000100:00100000:0.0:1789445894.039587:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445894.039987:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722139136 00000100:00100000:3.0:1789445894.039999:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722139136 00000100:00100000:3.0:1789445894.040134:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 209 00000100:00100000:3.0:1789445894.040147:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+58:11649:x1876369722139136:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445894.040176:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445894.040200:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256f1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e63 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445894.040262:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256f24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445894.040291:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445894.040304:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445894.040348:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789445894.040352:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789445894.040368:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445894.040393:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256f1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e63 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789445894.040402:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789445894.040410:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256f24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e63 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445894.040418:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:3.0:1789445894.040421:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789445894.040424:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e988e00, rc 0) 00000100:00100000:3.0:1789445894.040648:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:11649:x1876369722139136:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 503us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445894.040656:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 209 00000100:00100000:3.0:1789445894.046759:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445894.046872:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722139264 00000100:00100000:0.0:1789445894.046882:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722139264 00000100:00100000:0.0:1789445894.046999:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 210 00000100:00100000:0.0:1789445894.047010:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:11649:x1876369722139264:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:0.0:1789445894.047031:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445894.047089:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256f2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e6a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047171:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256f32 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047185:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256f32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047196:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256f32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047231:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256f39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047248:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256f39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047256:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256f39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047351:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256f40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047360:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256f40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047367:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256f40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445894.047399:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789445894.047404:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789445894.047423:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256f40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047435:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256f40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047442:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256f32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047448:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256f32 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047467:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256f32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047473:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445894.047477:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256f32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047484:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256f32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047496:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:0.0:1789445894.047498:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445894.047503:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256f32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047508:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47256f32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047519:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256f39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047525:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256f39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047530:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256f39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047535:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789445894.047538:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256f39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047553:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256f39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047563:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe98961b00) 00010000:00010000:0.0:1789445894.047565:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445894.047568:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256f39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047574:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907600/0xc1b37c4d47256f39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047609:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907000/0xc1b37c4d47256f2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e6a expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047622:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256f40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e6a expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445894.047628:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:0.0:1789445894.047630:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789445894.047633:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906e00, rc 0) 00000100:00100000:0.0:1789445894.047692:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+60:11649:x1876369722139264:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 684us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445894.047699:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 210 00000100:00100000:0.0:1789445894.053714:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445894.053770:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445894.053839:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722139648 00000100:00100000:3.0:1789445894.053849:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722139648 00000100:00100000:3.0:1789445894.053908:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 15 00000100:00100000:3.0:1789445894.053918:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+60:2375:x1876369722139648:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445894.053944:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445894.053967:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906e00/0xc1b37c4d47256f40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e6a expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445894.053984:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:3.0:1789445894.053989:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445894.054069:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:2375:x1876369722139648:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 153us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445894.054077:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 15 00000100:00100000:2.0:1789445894.054555:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722139520 00000100:00100000:2.0:1789445894.054561:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722139520 00000100:00100000:2.0:1789445894.054592:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 211 00000100:00100000:2.0:1789445894.054599:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebfbc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:11649:x1876369722139520:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:2.0:1789445894.054615:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445894.054630:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256f47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e71 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445894.054727:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256f4e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445894.054742:0:8204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e5c expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445894.054750:0:8204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256f4e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445894.054784:0:8204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e5c expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445894.054799:0:8204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e5c expref: 60 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445894.054814:0:8204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8204:1876369742049152:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445894.054901:0:8204:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe91474d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789445894.060745:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445894.060830:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722139776 00000100:00100000:1.0:1789445894.060838:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722139776 00010000:00010000:1.0:1789445894.060873:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f16 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e5c expref: 61 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445894.060911:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 81 00000100:00100000:1.0:1789445894.060920:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe87d87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+61:2375:x1876369722139776:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789445894.060933:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445894.060940:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f16 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e5c expref: 61 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445894.060969:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e5c expref: 61 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445894.060990:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:1.0:1789445894.060995:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256f4e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445894.061004:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256f4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445894.061011:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256f4e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445894.061029:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445894.061103:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe87d87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+61:2375:x1876369722139776:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 183us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445894.061111:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 81 00010000:00010000:2.0:1789445894.061286:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e5c expref: 60 pid: 5841 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445894.061308:0:8204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8204:1876369742049152:192.168.206.59@tcp:104: 00010000:00010000:2.0:1789445894.061336:0:8204:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256f4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445894.061345:0:8204:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256f4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445894.061351:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256f4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445894.061368:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789445894.061509:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256f47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e71 expref: 61 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445894.061524:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256f4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e71 expref: 60 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445894.061531:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:2.0:1789445894.061533:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789445894.061535:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bfc00, rc 0) 00000100:00100000:2.0:1789445894.061561:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebfbc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+60:11649:x1876369722139520:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 6962us (7856us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789445894.061568:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 211 00000100:00100000:1.0:1789445894.065815:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445894.066167:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722140032 00000100:00100000:3.0:1789445894.066177:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722140032 00000100:00100000:3.0:1789445894.066392:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 16 00000100:00100000:3.0:1789445894.066406:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead814000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+60:11649:x1876369722140032:12345-192.168.206.59@tcp:103:lfs.0 00010000:00010000:3.0:1789445894.066432:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445894.066457:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256ead lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e47 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445894.066474:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:3.0:1789445894.066479:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445894.066535:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead814000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:11649:x1876369722140032:12345-192.168.206.59@tcp:103:lfs.0 Request processed in 132us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445894.068826:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 16 00000100:00100000:3.0:1789445894.070221:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445894.070958:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722140160 00000100:00100000:2.0:1789445894.070968:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722140160 00000100:00100000:2.0:1789445894.071304:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 212 00000100:00100000:2.0:1789445894.071315:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:11649:x1876369722140160:12345-192.168.206.59@tcp:58:lfs.0 00010000:00010000:2.0:1789445894.071454:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256f5c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445894.071471:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256f5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445894.071482:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256f5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789445894.071673:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789445894.071756:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:11649:x1876369722140160:12345-192.168.206.59@tcp:58:lfs.0 Request processed in 444us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445894.071764:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 212 00000100:00100000:1.0:1789445894.075616:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445894.075993:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722140288 00000100:00100000:0.0:1789445894.076003:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722140288 00000100:00100000:1.0:1789445894.076578:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 213 00000100:00100000:1.0:1789445894.076588:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+59:11649:x1876369722140288:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:1.0:1789445894.076607:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445894.076626:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256f63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e78 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445894.076791:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256f5c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445894.076814:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256f63 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e78 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445894.076833:0:5840:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256f5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445894.076847:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256f63 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e78 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445894.076859:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:1.0:1789445894.076862:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789445894.076865:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256f63 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e78 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445894.076873:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6f200, rc 0) 00000100:00100000:1.0:1789445894.076933:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+60:11649:x1876369722140288:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 346us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445894.076940:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 213 00000100:00100000:1.0:1789445894.234549:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742049280:0@lo:400:kworker.0 00000100:00100000:1.0:1789445894.234624:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445894.234757:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742049280 00000100:00100000:0.0:1789445894.234765:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742049280 00000100:00100000:0.0:1789445894.234826:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789445894.234836:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742049280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445894.236294:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81217480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742049664:0@lo:400:kworker.0 00000100:00100000:3.0:1789445894.236364:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445894.236421:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742049664 00000100:00100000:3.0:1789445894.236441:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742049664 00000100:00100000:3.0:1789445894.236482:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789445894.236490:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1876369742049664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445894.236534:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1876369742049664:12345-0@lo:400:kworker.0 Request processed in 45us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445894.236542:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789445894.236593:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81217480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742049664:0@lo:400:kworker.0 00000100:00100000:3.0:1789445894.237891:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876369742049536:0@lo:400:kworker.0 00000100:00100000:3.0:1789445894.237939:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445894.237968:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789445894.237973:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876369742049408:0@lo:400:kworker.0 00000100:00100000:3.0:1789445894.237991:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445894.241893:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742049536 00000100:00100000:3.0:1789445894.241910:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742049536 00000100:00100000:3.0:1789445894.241996:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789445894.242007:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876369742049536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445894.242117:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876369742049536:12345-0@lo:400:kworker.0 Request processed in 112us (4176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445894.242125:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789445894.242173:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876369742049536:0@lo:400:kworker.0 00000100:00100000:3.0:1789445894.242202:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742049408 00000100:00100000:3.0:1789445894.242206:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742049408 00000100:00100000:3.0:1789445894.242230:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789445894.242236:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876369742049408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445894.242285:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876369742049408:12345-0@lo:400:kworker.0 Request processed in 49us (4292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445894.242310:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789445894.242349:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876369742049408:0@lo:400:kworker.0 00000100:00100000:0.0:1789445894.242751:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742049280:12345-0@lo:400:kworker.0 Request processed in 7915us (8125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445894.242761:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:0.0:1789445894.242830:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789445894.242913:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742049280:0@lo:400:kworker.0 00000100:00100000:1.0:1789445894.243166:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742049792:0@lo:400:kworker.0 00000100:00100000:1.0:1789445894.243203:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445894.243378:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789445894.243388:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742049920:0@lo:400:kworker.0 00000100:00100000:2.0:1789445894.243418:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445894.245818:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742049920 00000100:00100000:0.0:1789445894.245836:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742049920 00000100:00100000:0.0:1789445894.245929:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789445894.245944:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1876369742049920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445894.246073:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1876369742049920:12345-0@lo:400:kworker.0 Request processed in 106us (2624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445894.246081:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789445894.246145:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742049920:0@lo:400:kworker.0 00000100:00080000:1.0:1789445894.246227:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789445894.247383:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742049792 00000100:00100000:3.0:1789445894.247395:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742049792 00000100:00100000:3.0:1789445894.247520:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789445894.247529:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742049792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445894.247607:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742049792:12345-0@lo:400:kworker.0 Request processed in 79us (4403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445894.247614:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789445894.249417:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742049792:0@lo:400:kworker.0 00000100:00080000:1.0:1789445894.250745:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789445894.746510:0:7985:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332768461373ns, next at 333768457244ns, rc = 0 00000100:00100000:2.0:1789445894.746548:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742050048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789445894.746691:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445894.746913:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742050048 00000100:00100000:3.0:1789445894.746934:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742050048 00000100:00100000:3.0:1789445894.747023:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789445894.747036:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876369742050048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789445894.747111:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789445894.747179:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876369742050048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445894.747189:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789445894.748432:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742050048:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789445894.874637:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789445895.004062:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789445895.004071:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789445895.004109:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789445895.004116:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789445895.004277:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba73dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1876369742050176:192.168.206.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789445895.004405:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87ddee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789445895.010331:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445895.010454:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722140416 00000100:00100000:2.0:1789445895.010475:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722140416 00000100:00100000:2.0:1789445895.010579:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 214 00000100:00100000:2.0:1789445895.010593:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+61:11650:x1876369722140416:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789445895.010641:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789445895.010817:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+61:11650:x1876369722140416:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 Request processed in 226us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445895.010826:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 214 00000100:00100000:0.0:1789445895.014578:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba73dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1876369742050176:192.168.206.59@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789445895.017335:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445895.017495:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722140544 00000100:00100000:3.0:1789445895.017510:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722140544 00000100:00100000:3.0:1789445895.017584:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 215 00000100:00100000:3.0:1789445895.017597:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+60:11650:x1876369722140544:12345-192.168.206.59@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789445895.017694:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256f6a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.017717:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256f6a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.017754:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256f6a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.017773:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256f71 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.017781:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256f71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.017788:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256f71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.017820:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256f78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.017830:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256f78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.017837:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256f78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445895.017893:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789445895.017899:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789445895.017918:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256f78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.017931:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256f6a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.017940:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256f6a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.017960:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256f6a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.017967:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445895.017972:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256f6a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.017981:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256f6a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.017997:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afe858f5c00) 00010000:00010000:3.0:1789445895.018000:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445895.018006:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256f6a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.018012:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47256f6a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.018029:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256f71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.018036:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256f71 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.018042:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256f71 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.018234:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445895.018238:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256f71 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.018256:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256f71 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.018271:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9afe8e97a300) 00010000:00010000:3.0:1789445895.018273:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445895.018276:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256f71 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.018282:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256f71 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.018301:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256f78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.018313:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256f78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.018329:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256f78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.018335:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445895.018337:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256f78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.018344:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256f78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.018352:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:3.0:1789445895.018355:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445895.018358:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256f78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.018375:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256f78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445895.018492:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+60:11650:x1876369722140544:12345-192.168.206.59@tcp:34:lhsmtool_posix.0 Request processed in 894us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445895.018503:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 215 00000100:00100000:3.0:1789445895.027711:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445895.027795:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722140800 00000100:00100000:2.0:1789445895.027812:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722140800 00000100:00100000:2.0:1789445895.027894:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 216 00000100:00100000:2.0:1789445895.027908:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+60:11650:x1876369722140800:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789445895.027937:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445895.027964:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256f7f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e7f expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.028155:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.028175:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.028190:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445895.028205:0:8204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789445895.028354:0:8204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.028363:0:8204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.028370:0:8204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.028376:0:8204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445895.028381:0:8204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.028390:0:8204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.028423:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:2.0:1789445895.028427:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789445895.028434:0:8204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.028441:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.028497:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256f7f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e7f expref: 62 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.028508:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afe858f5c00) 00010000:00010000:2.0:1789445895.028511:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789445895.028514:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256f7f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e7f expref: 62 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.028526:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf000, rc 0) 00000100:00100000:2.0:1789445895.028622:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+61:11650:x1876369722140800:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 715us (926us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1789445895.028632:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 216 00000100:00100000:1.0:1789445895.037529:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445895.037644:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722140928 00000100:00100000:2.0:1789445895.037655:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722140928 00000100:00100000:2.0:1789445895.037885:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 217 00000100:00100000:2.0:1789445895.037899:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+61:11650:x1876369722140928:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789445895.037956:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789445895.038105:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+61:11650:x1876369722140928:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 Request processed in 209us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445895.038130:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 217 00000100:00100000:3.0:1789445895.043205:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445895.043479:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722141184 00000100:00100000:2.0:1789445895.043489:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722141184 00000100:00100000:2.0:1789445895.043549:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 218 00000100:00100000:2.0:1789445895.043561:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+61:11650:x1876369722141184:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789445895.043582:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445895.043585:0:8204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789445895.043611:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d47256f24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e63 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.043635:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:2.0:1789445895.043641:0:8204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789445895.043657:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256f94 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e86 expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789445895.045172:0:8204:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1789445895.046010:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.046030:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.046073:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.046147:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256f94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e86 expref: 63 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.046185:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e86 expref: 62 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.046195:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9afe90eac900) 00010000:00010000:2.0:1789445895.046198:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789445895.046201:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf600, rc 0) 00000100:00100000:2.0:1789445895.046304:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+62:11650:x1876369722141184:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 2744us (3110us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789445895.046314:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 218 00000100:00100000:0.0:1789445895.066972:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445895.068160:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722141440 00000100:00100000:3.0:1789445895.068176:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722141440 00000100:00100000:3.0:1789445895.068266:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 219 00000100:00100000:3.0:1789445895.068278:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+62:11650:x1876369722141440:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789445895.068362:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445895.068392:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d47256f9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e86 expref: 62 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068415:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9afe90eac900) 00010000:00010000:3.0:1789445895.068427:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789445895.068451:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fa9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068467:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068477:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068493:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x380b4ac3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068513:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x380b4ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068519:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x380b4ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068589:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068596:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fa9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068603:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fa9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068609:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445895.068613:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fa9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068620:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fa9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068629:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:3.0:1789445895.068632:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445895.068636:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fa9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068642:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fa9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068652:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x380b4ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068663:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fb0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x380b4ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068668:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x380b4ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068673:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445895.068676:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x380b4ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068681:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fb0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x380b4ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068689:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x380b4ac3 (ffff9afe8e97a300) 00010000:00010000:3.0:1789445895.068691:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789445895.068694:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fb0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x380b4ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.068700:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x380b4ac3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445895.068926:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+61:11650:x1876369722141440:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 Request processed in 648us (1964us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789445895.068933:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 219 00000100:00100000:0.0:1789445895.072946:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445895.073094:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722141568 00000100:00100000:2.0:1789445895.073106:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722141568 00000100:00100000:2.0:1789445895.073188:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 220 00000100:00100000:2.0:1789445895.073200:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+61:11650:x1876369722141568:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789445895.073224:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445895.073250:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256fb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e8d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.073291:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256fbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.073308:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256fbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.073333:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256fbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.073442:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256fb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e8d expref: 63 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.073469:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256fbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e8d expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.073478:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9afe90eac600) 00010000:00010000:2.0:1789445895.073481:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789445895.073485:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57be800, rc 0) 00000100:00100000:2.0:1789445895.073553:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+62:11650:x1876369722141568:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 355us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445895.073561:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 220 00000100:00100000:1.0:1789445895.076846:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445895.077470:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722141824 00000100:00100000:3.0:1789445895.077480:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722141824 00000100:00100000:3.0:1789445895.077547:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 221 00000100:00100000:3.0:1789445895.077559:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+62:11650:x1876369722141824:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789445895.077667:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fc5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.077699:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.077710:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789445895.077981:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:3.0:1789445895.078104:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc403c04 reply state 000000008e2317b5 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445895.078113:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789445895.078228:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+64:11650:x1876369722141824:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 Request processed in 671us (1392us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1789445895.078236:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 221 00010000:00010000:2.0:1789445895.088714:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.088743:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fc5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.088751:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445895.088756:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00010000:00010000:2.0:1789445895.088758:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445895.088763:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.088771:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fc5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.088790:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9afe90eac600) 00010000:00010000:2.0:1789445895.088794:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789445895.088800:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fc5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.088819:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47256fc5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445895.089658:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722141952 00000100:00100000:3.0:1789445895.089683:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722141952 00000100:00100000:3.0:1789445895.089776:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 222 00000100:00100000:3.0:1789445895.089789:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+63:11650:x1876369722141952:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789445895.089820:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445895.089843:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.089906:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e94 expref: 64 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.089921:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e94 expref: 64 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.089953:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9afe90eac600) 00010000:00010000:3.0:1789445895.089956:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789445895.089959:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989400, rc 0) 00000100:00100000:3.0:1789445895.090017:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+64:11650:x1876369722141952:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 232us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445895.090024:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 222 00000100:00100000:0.0:1789445895.094955:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445895.099381:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722142080 00000100:00100000:3.0:1789445895.099404:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722142080 00000100:00100000:3.0:1789445895.099529:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 62 00000100:00100000:3.0:1789445895.099541:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:2374:x1876369722142080:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789445895.100259:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+10:2374:x1876369722142080:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 Request processed in 717us (5308us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1789445895.100268:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 62 00000100:00080000:1.0:1789445895.100600:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789445895.104302:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445895.105608:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722142336 00000100:00100000:3.0:1789445895.105621:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722142336 00000100:00100000:3.0:1789445895.105684:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 60 00000100:00100000:3.0:1789445895.105705:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+64:11650:x1876369722142336:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789445895.107827:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+65:11650:x1876369722142336:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 Request processed in 2112us (3523us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1789445895.107842:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 60 00000100:00100000:0.0:1789445895.124431:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445895.124670:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722142592 00000100:00100000:3.0:1789445895.124684:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722142592 00000100:00100000:3.0:1789445895.124768:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 223 00000100:00100000:3.0:1789445895.124783:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+65:11650:x1876369722142592:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789445895.124972:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+65:11650:x1876369722142592:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 Request processed in 193us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445895.124981:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 223 00000100:00100000:1.0:1789445895.138222:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445895.138579:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722142720 00000100:00100000:2.0:1789445895.138597:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722142720 00000100:00100000:2.0:1789445895.138692:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 224 00000100:00100000:2.0:1789445895.138705:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+65:11650:x1876369722142720:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789445895.138726:0:8204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445895.138747:0:8204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256fd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4e9b expref: -99 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.138854:0:8204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256fda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.138872:0:8204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256fda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.138885:0:8204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256fda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445895.138947:0:8204:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789445895.138970:0:8204:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256fda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.138999:0:8204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf000/0xc1b37c4d47256fd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e9b expref: 67 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.139021:0:8204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256fda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e9b expref: 66 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.139115:0:8204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9afe90eac600) 00010000:00010000:2.0:1789445895.139119:0:8204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789445895.139124:0:8204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57be400, rc 0) 00000100:00100000:2.0:1789445895.139210:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+66:11650:x1876369722142720:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 506us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445895.139220:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 224 00000100:00100000:1.0:1789445895.147365:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445895.147479:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722142848 00000100:00100000:0.0:1789445895.147490:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722142848 00000100:00100000:0.0:1789445895.147549:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 63 00000100:00100000:0.0:1789445895.147562:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+10:2375:x1876369722142848:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789445895.147581:0:11692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445895.147602:0:11692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043aae469/0xc1b37c4d47256fe1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ea2 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789445895.147853:0:11692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa8c707, blocks: 0x1 00010000:00010000:0.0:1789445895.147878:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=333s v=(0 0) 00010000:00010000:0.0:1789445895.147883:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445895.147893:0:11692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043aae469/0xc1b37c4d47256fe1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea2 expref: 11 pid: 11692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.147915:0:11692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043aae469/0xc1b37c4d47256fe1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea2 expref: 11 pid: 11692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.147929:0:11692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906800, rc 0) 00000100:00100000:0.0:1789445895.148074:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+11:2375:x1876369722142848:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 514us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445895.148081:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 63 00000100:00100000:1.0:1789445895.154552:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445895.154776:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722143104 00000100:00100000:2.0:1789445895.154788:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722143104 00000100:00100000:2.0:1789445895.154855:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 225 00000100:00100000:2.0:1789445895.154866:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+66:11650:x1876369722143104:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789445895.155021:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+66:11650:x1876369722143104:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 Request processed in 155us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445895.155029:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 225 00000100:00100000:1.0:1789445895.158502:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445895.161311:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722143232 00000100:00100000:0.0:1789445895.161356:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722143232 00000100:00100000:0.0:1789445895.161502:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 64 00000100:00100000:0.0:1789445895.161515:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afead817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+11:11650:x1876369722143232:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789445895.161535:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445895.161558:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d47256fe8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ea9 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.161591:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043aae469/0xc1b37c4d47256fe1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea2 expref: 12 pid: 11692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.161601:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445895.161606:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445895.161612:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d47256fe8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea9 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.162617:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043aae469/0xc1b37c4d47256fe1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea2 expref: 12 pid: 11692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.162651:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043aae469/0xc1b37c4d47256fe1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea2 expref: 12 pid: 11692 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445895.162681:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba62bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876369742050304:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445895.162811:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87ddee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789445895.169383:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445895.170288:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722143360 00000100:00100000:2.0:1789445895.170299:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722143360 00010000:00010000:2.0:1789445895.170367:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043aae469/0xc1b37c4d47256fe1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea2 expref: 13 pid: 11692 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445895.170644:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 82 00000100:00100000:2.0:1789445895.170792:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:2374:x1876369722143360:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445895.170814:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445895.170846:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043aae469/0xc1b37c4d47256fe1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea2 expref: 13 pid: 11692 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.170890:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043aae469/0xc1b37c4d47256fe1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea2 expref: 13 pid: 11692 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.170920:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445895.170925:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445895.170936:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d47256fe8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea9 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.170947:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d47256fe8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea9 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.170986:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d47256fe8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea9 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445895.171002:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1876369742050432:192.168.206.59@tcp:105: 00000100:00100000:2.0:1789445895.171220:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d538a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789445895.174987:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1876369742050432:192.168.206.59@tcp:105: 00010000:00010000:2.0:1789445895.175015:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445895.175110:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:2374:x1876369722143360:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 4455us (5740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445895.175122:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 82 00010000:00010000:0.0:1789445895.176697:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043aae469/0xc1b37c4d47256fe1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea2 expref: 12 pid: 11692 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445895.176751:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba62bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876369742050304:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789445895.176791:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d47256fe8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea9 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.176806:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907400, rc 0) 00000100:00100000:0.0:1789445895.176865:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afead817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+11:11650:x1876369722143232:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 15352us (18375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445895.176873:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 64 00000100:00100000:1.0:1789445895.182913:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445895.183007:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722143488 00000100:00100000:0.0:1789445895.183019:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722143488 00002000:00100000:0.0:1789445895.183112:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9afeb5c7b480 x1876369722143488/t0(0) o4->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:21/0 lens 504/0 e 0 to 0 dl 1789445906 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789445895.183134:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afeb5c7b480 with x1876369722143488 ext(0->12) 00002000:00010000:0.0:1789445895.183140:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afeb5c7b480 00000100:00100000:0.0:1789445895.183173:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00100000:0.0:1789445895.183186:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+11:2375:x1876369722143488:12345-192.168.206.59@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789445895.183959:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:2375:x1876369722143488:12345-192.168.206.59@tcp:4:lhsmtool_posix.0 Request processed in 771us (1055us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789445895.183968:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 6 00002000:00100000:0.0:1789445895.183977:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9afeb5c7b480 x1876369722143488/t4294967320(0) o4->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:21/0 lens 504/448 e 0 to 0 dl 1789445906 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789445895.183987:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afeb5c7b480 with x1876369722143488 ext(0->12) 00002000:00010000:0.0:1789445895.183999:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afeb5c7b480 00000100:00100000:1.0:1789445895.190968:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445895.191748:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722143616 00000100:00100000:2.0:1789445895.191761:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722143616 00000100:00100000:2.0:1789445895.191838:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 226 00000100:00100000:2.0:1789445895.191884:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+66:11650:x1876369722143616:12345-192.168.206.59@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789445895.242787:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+66:11650:x1876369722143616:12345-192.168.206.59@tcp:44:lhsmtool_posix.0 Request processed in 50901us (51820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445895.242799:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 226 00000001:00080000:0.0:1789445895.242834:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967483 is committed 00000020:00080000:0.0:1789445895.242857:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9afe85da7f00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789445895.242860:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afeb54f9d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9afe85da73c0 00000020:00080000:0.0:1789445895.242864:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afeb54f9200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9afebb4f2400 00000020:00080000:0.0:1789445895.242880:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:0.0:1789445895.242887:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000001:00080000:0.0:1789445895.242896:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000004:00080000:0.0:1789445895.242909:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789445895.242919:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9afd82cb4d80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789445895.242923:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afead9f9300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9afd82cb4c00 00000020:00080000:0.0:1789445895.242925:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afead9f9b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9afebff81400 00000001:00080000:0.0:1789445895.242942:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1789445895.242948:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1789445895.242971:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1789445895.242987:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789445895.243370:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789445895.243519:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742050688:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789445895.243574:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445895.243631:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789445895.243637:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742050560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789445895.244282:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445895.246300:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742050688 00000100:00100000:2.0:1789445895.246327:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742050688 00000100:00100000:2.0:1789445895.246400:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742050560 00000100:00100000:2.0:1789445895.246405:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742050560 00000100:00100000:2.0:1789445895.246468:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789445895.246480:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1876369742050688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789445895.246521:0:11692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1789445895.246552:0:11692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032d4276d/0xc1b37c4d47256fef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.246577:0:11692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d47256db1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e08 expref: 12 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.246586:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1789445895.246590:0:11692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789445895.246594:0:11692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032d4276d/0xc1b37c4d47256fef lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.246642:0:11692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d47256db1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e08 expref: 12 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.246875:0:11692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d47256db1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e08 expref: 12 pid: 11692 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445895.246892:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11692:1876369742050816:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789445895.246994:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe9d538a80 going to sleep for 11 seconds 00000100:00080000:1.0:1789445895.247108:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445895.247838:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789445895.247856:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1876369742050560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789445895.247880:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1789445895.247911:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa8c705, atime: 0x6aa8c705, ctime: 0x6aa8c705, blocks: 0x1 00010000:00010000:3.0:1789445895.247918:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f11e1a07/0xc1b37c4d47256ff6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.247931:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=333s v=(0 0) 00010000:00010000:3.0:1789445895.247934:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445895.247940:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f11e1a07/0xc1b37c4d47256ff6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.247955:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f11e1a07/0xc1b37c4d47256ff6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.247964:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f11e1a07/0xc1b37c4d47256ff6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.247972:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f11e1a07/0xc1b37c4d47256ff6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.247999:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789445895.248626:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3313:x1876369742050560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 776us (4343us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789445895.248641:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:1.0:1789445895.251152:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afeba62bb80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789445895.251171:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742050560:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789445895.251336:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445895.251346:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f11e1a07/0xc1b37c4d47256ff6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.251358:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989600 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445895.251362:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f11e1a07/0xc1b37c4d47256ff6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.251374:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f11e1a07/0xc1b37c4d47256ff6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.251394:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f11e1a07/0xc1b37c4d47256ff6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.251402:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f11e1a07/0xc1b37c4d47256ff6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.251424:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445895.251426:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445895.251428:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445895.256301:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445895.256433:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445895.256618:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11692:1876369742050816:192.168.206.59@tcp:104: 00010000:00010000:2.0:1789445895.256646:0:11692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032d4276d/0xc1b37c4d47256fef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445895.256930:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722143872 00000100:00100000:0.0:1789445895.256957:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722143872 00010000:00010000:0.0:1789445895.256996:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d47256db1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e08 expref: 13 pid: 11692 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445895.257074:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 83 00000100:00100000:0.0:1789445895.257084:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+13:2374:x1876369722143872:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789445895.257101:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445895.257108:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d47256db1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e08 expref: 13 pid: 11692 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.257120:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d47256db1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e08 expref: 13 pid: 11692 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.257155:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d47256db1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e08 expref: 13 pid: 11692 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.257171:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789445895.257175:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789445895.257181:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032d4276d/0xc1b37c4d47256fef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.257191:0:7627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032d4276d/0xc1b37c4d47256fef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.257218:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445895.257280:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+12:2374:x1876369722143872:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 197us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445895.257294:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 83 00010000:00010000:2.0:1789445895.258357:0:11692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032d4276d/0xc1b37c4d47256fef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.258387:0:11692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032d4276d/0xc1b37c4d47256fef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.258398:0:11692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032d4276d/0xc1b37c4d47256fef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.258407:0:11692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032d4276d/0xc1b37c4d47256fef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.258441:0:11692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789445895.261304:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1876369742050688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14820us (17721us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789445895.261329:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789445895.261494:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722143744 00000100:00100000:2.0:1789445895.261502:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722143744 00000100:00100000:3.0:1789445895.264715:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 67 00000100:00100000:3.0:1789445895.264762:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+12:2374:x1876369722143744:12345-192.168.206.59@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1789445895.265201:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afeba629500/2, rc 0, transno 4294967321 00000100:00100000:1.0:1789445895.265216:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742050688:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789445895.265338:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789445895.265347:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032d4276d/0xc1b37c4d47256fef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.265359:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf000 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445895.265364:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032d4276d/0xc1b37c4d47256fef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.265375:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032d4276d/0xc1b37c4d47256fef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.265396:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032d4276d/0xc1b37c4d47256fef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.265404:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032d4276d/0xc1b37c4d47256fef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.265426:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445895.265429:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445895.265430:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789445895.315379:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1789445895.315399:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1789445895.315405:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1789445895.315412:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1789445895.333335:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:0.0:1789445895.333365:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:0.0:1789445895.333373:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1789445895.333545:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2374:x1876369722143744:12345-192.168.206.59@tcp:16:lhsmtool_posix.0 Request processed in 68810us (77245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445895.333558:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 67 00000100:00100000:1.0:1789445895.338608:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445895.338793:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722144128 00000100:00100000:2.0:1789445895.338803:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722144128 00000100:00100000:2.0:1789445895.338907:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 227 00000100:00100000:2.0:1789445895.338997:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:11650:x1876369722144128:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789445895.339106:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445895.339142:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47256fda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e9b expref: 20 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.339162:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9afe90eac600) 00010000:00010000:2.0:1789445895.339168:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789445895.339217:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ffd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.339232:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ffd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.339242:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ffd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789445895.339541:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f02ae0b2 reply state 00000000f1c5fe9f transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ffd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445895.339552:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789445895.339649:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:11650:x1876369722144128:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 Request processed in 732us (1049us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789445895.340254:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 227 00000100:00100000:0.0:1789445895.344528:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00010000:00010000:1.0:1789445895.345212:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ffd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.345251:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ffd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.345260:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ffd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.345268:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bee00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445895.345274:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ffd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.345283:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ffd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.345304:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9afe90eac600) 00010000:00010000:1.0:1789445895.345308:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445895.345327:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ffd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.345334:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bee00/0xc1b37c4d47256ffd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445895.345581:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722144256 00000100:00100000:3.0:1789445895.345596:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722144256 00000100:00100000:3.0:1789445895.345743:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 68 00000100:00100000:3.0:1789445895.345753:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2375:x1876369722144256:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789445895.346253:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789445895.346258:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789445893 00002000:00010000:3.0:1789445895.346261:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789445893 00002000:00010000:3.0:1789445895.346262:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789445895 -> 1789445893 00002000:00010000:3.0:1789445895.346264:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789445895.346373:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2375:x1876369722144256:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 Request processed in 620us (1856us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789445895.346384:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 68 00000100:00100000:0.0:1789445895.353839:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445895.354071:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722144512 00000100:00100000:3.0:1789445895.354081:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722144512 00000100:00100000:3.0:1789445895.354144:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 228 00000100:00100000:3.0:1789445895.354155:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:11650:x1876369722144512:12345-192.168.206.59@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789445895.354229:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257004 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.354248:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256fbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e8d expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.354259:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257004 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.354294:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256fbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e8d expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.354342:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256fbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e8d expref: 20 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445895.354359:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9f1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742050944:192.168.206.59@tcp:104: 00000100:00100000:3.0:1789445895.354457:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afd82cb4780 going to sleep for 11 seconds 00000100:00100000:1.0:1789445895.357541:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445895.357627:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722144640 00000100:00100000:0.0:1789445895.357635:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722144640 00010000:00010000:0.0:1789445895.357683:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256fbe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e8d expref: 21 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445895.357725:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 84 00000100:00100000:0.0:1789445895.357735:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:2375:x1876369722144640:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789445895.357748:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445895.357755:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256fbe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e8d expref: 21 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.357768:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256fbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e8d expref: 21 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.357788:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9afe90eac600) 00010000:00010000:0.0:1789445895.357793:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257004 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.357803:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257004 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.357811:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257004 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.357845:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445895.357897:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:2375:x1876369722144640:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 163us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445895.357904:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 84 00010000:00010000:3.0:1789445895.359191:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47256fbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e8d expref: 20 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445895.359212:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9f1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876369742050944:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789445895.359232:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257004 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.359241:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257004 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.359246:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257004 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.359272:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257004 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.359278:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257004 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.359284:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257004 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.359290:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445895.359305:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257004 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.359312:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257004 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.359336:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9afe90eac600) 00010000:00010000:3.0:1789445895.359339:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789445895.359343:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257004 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.359348:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257004 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445895.359407:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:11650:x1876369722144512:12345-192.168.206.59@tcp:55:lhsmtool_posix.0 Request processed in 5254us (5578us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789445895.359415:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 228 00000100:00100000:1.0:1789445895.362622:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445895.362735:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722144768 00000100:00100000:0.0:1789445895.362747:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722144768 00000100:00100000:0.0:1789445895.362808:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 69 00000100:00100000:0.0:1789445895.362819:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2374:x1876369722144768:12345-192.168.206.59@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789445895.362872:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d4725700b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.362897:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d47256fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea9 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.362906:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445895.362911:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789445895.362915:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d4725700b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.362956:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d47256fe8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea9 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.362969:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d47256fe8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea9 expref: 8 pid: 6682 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445895.362982:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba629180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1876369742051072:192.168.206.59@tcp:104: 00000100:00100000:0.0:1789445895.363104:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb56f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789445895.368240:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445895.368374:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba629180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1876369742051072:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789445895.368411:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d4725700b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445895.368858:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722144896 00000100:00100000:3.0:1789445895.368867:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722144896 00010000:00010000:3.0:1789445895.368904:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d47256fe8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea9 expref: 9 pid: 6682 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445895.368947:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 85 00000100:00100000:3.0:1789445895.368957:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf760380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+9:2374:x1876369722144896:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445895.368971:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445895.368993:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d47256fe8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea9 expref: 9 pid: 6682 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.369005:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d47256fe8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea9 expref: 9 pid: 6682 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.369040:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9fe9ab9/0xc1b37c4d47256fe8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ea9 expref: 9 pid: 6682 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.369078:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789445895.369082:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789445895.369087:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d4725700b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.369098:0:7627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d4725700b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.369119:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789445895.369440:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf760380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2374:x1876369722144896:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 483us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445895.369448:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 85 00010000:00010000:0.0:1789445895.369679:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d4725700b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.369689:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d4725700b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.369714:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d4725700b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.369722:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d4725700b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.369729:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d4725700b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.369736:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445895.369740:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d4725700b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.369747:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d4725700b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.369773:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d4725700b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.369779:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099deaed3/0xc1b37c4d4725700b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445895.369827:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2374:x1876369722144768:12345-192.168.206.59@tcp:1:lhsmtool_posix.0 Request processed in 7010us (7214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445895.369836:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 69 00000100:00100000:1.0:1789445895.372640:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445895.373150:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722145152 00000100:00100000:3.0:1789445895.373160:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722145152 00000100:00100000:3.0:1789445895.373217:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 229 00000100:00100000:3.0:1789445895.373228:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:11650:x1876369722145152:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789445895.373309:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257012 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.373337:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257012 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.373348:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257012 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.373546:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47257019 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.373559:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fcc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e94 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.373568:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47257019 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.373599:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e94 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.373613:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fcc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e94 expref: 20 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445895.373626:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9f1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742051200:192.168.206.59@tcp:104: 00000100:00100000:3.0:1789445895.373721:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afd82cb4780 going to sleep for 11 seconds 00000100:00100000:2.0:1789445895.378155:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445895.378282:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9f1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742051200:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789445895.378328:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47257019 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445895.378408:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722145280 00000100:00100000:0.0:1789445895.378428:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722145280 00010000:00010000:0.0:1789445895.378475:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fcc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e94 expref: 21 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445895.378511:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 86 00000100:00100000:0.0:1789445895.378521:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81216d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:2374:x1876369722145280:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789445895.378537:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445895.378543:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fcc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e94 expref: 21 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.378556:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e94 expref: 21 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.378576:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d47256fcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e94 expref: 21 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.378613:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9afe90eac600) 00010000:00010000:0.0:1789445895.378619:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47257019 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.378628:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47257019 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.378635:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47257019 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445895.378666:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445895.378728:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81216d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:2374:x1876369722145280:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 207us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445895.378735:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 86 00010000:00010000:3.0:1789445895.378805:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47257019 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.378812:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47257019 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789445895.378986:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1789445895.379181:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1789445895.379224:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1789445895.379299:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9f1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1876369742051328:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789445895.379357:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445895.379380:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afd82cb4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789445895.380015:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742051328 00000100:00100000:0.0:1789445895.380023:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742051328 00000100:00100000:0.0:1789445895.380077:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789445895.380085:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1876369742051328:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789445895.380163:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1876369742051328:12345-0@lo:1000:mdt00_002.0 Request processed in 80us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445895.380170:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789445895.380884:0:5842:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1789445895.380892:0:5842:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1789445895.380911:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afeba629500, transno 4294967321 00000100:00100000:3.0:1789445895.380940:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9f1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1876369742051328:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789445895.383437:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1789445895.384527:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf761180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1876369742051456:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789445895.384608:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445895.384645:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe83004240 going to sleep for 11 seconds 00000100:00100000:0.0:1789445895.384828:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742051456 00000100:00100000:0.0:1789445895.384835:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742051456 00000100:00100000:0.0:1789445895.384876:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789445895.384885:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1876369742051456:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789445895.385135:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1876369742051456:12345-0@lo:1000:mdt00_002.0 Request processed in 251us (526us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789445895.385152:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789445895.385499:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf761180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1876369742051456:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789445895.385534:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47257019 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.385544:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47257019 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.385552:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47257019 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.385558:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445895.385562:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47257019 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.385570:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47257019 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.385590:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9afe90eac600) 00010000:00010000:2.0:1789445895.385593:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789445895.385598:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47257019 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.385604:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d47257019 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.385636:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256f5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.385643:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256f5c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.385649:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256f5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.385665:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445895.385668:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256f5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.385674:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256f5c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.385682:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:2.0:1789445895.385685:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789445895.385691:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256f63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e78 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.385703:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256f63 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e78 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.385719:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256f63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e78 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445895.385749:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256f63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e78 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445895.385761:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742051584:192.168.206.59@tcp:105: 00000100:00100000:2.0:1789445895.385829:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea485b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445895.391108:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445895.391215:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876369742051584:192.168.206.59@tcp:105: 00010000:00010000:1.0:1789445895.391257:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256f5c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391269:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf400/0xc1b37c4d47256f5c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391300:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47257020 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391312:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47257020 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391337:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47257020 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391347:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47257020 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391353:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47257020 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391358:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47257020 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391364:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6fa00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445895.391367:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47257020 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391374:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47257020 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391385:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:1.0:1789445895.391388:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445895.391398:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47257020 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391404:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6fa00/0xc1b37c4d47257020 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391427:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257012 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391433:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257012 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391439:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257012 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391445:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445895.391448:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257012 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391453:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257012 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391461:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:1.0:1789445895.391463:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789445895.391466:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257012 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.391472:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257012 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445895.391702:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:11650:x1876369722145152:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 Request processed in 18475us (19069us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1789445895.391712:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 229 00000020:00080000:1.0:1789445895.391724:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789445895.392170:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789445895.392175:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1789445895.393475:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722145408 00000100:00100000:0.0:1789445895.393488:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722145408 00000100:00100000:0.0:1789445895.393546:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 61 00000100:00100000:0.0:1789445895.393557:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:11649:x1876369722145408:12345-192.168.206.59@tcp:49:lfs.0 00000100:00100000:0.0:1789445895.393678:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:11649:x1876369722145408:12345-192.168.206.59@tcp:49:lfs.0 Request processed in 123us (2580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445895.393685:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 61 00000040:00080000:2.0:1789445895.395095:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789445895.395113:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789445895.398866:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445895.399856:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722145664 00000100:00100000:1.0:1789445895.399872:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722145664 00000100:00100000:1.0:1789445895.399938:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 230 00000100:00100000:1.0:1789445895.399948:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:11649:x1876369722145664:12345-192.168.206.59@tcp:58:lfs.0 00000040:00080000:1.0:1789445895.400383:0:8204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789445895.400495:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:11649:x1876369722145664:12345-192.168.206.59@tcp:58:lfs.0 Request processed in 547us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445895.400503:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 230 00000100:00100000:2.0:1789445895.400934:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445895.402479:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722145920 00000100:00100000:3.0:1789445895.402494:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722145920 00000100:00100000:3.0:1789445895.402558:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 62 00000100:00100000:3.0:1789445895.402569:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c02050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+23:11650:x1876369722145920:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789445895.403350:0:11955:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789445895.403459:0:11955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1789445895.403512:0:11955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257027 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.403529:0:11955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.403542:0:11955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.403550:0:11955:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257027 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.403557:0:11955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257027 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.403576:0:11955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257027 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.403597:0:11955:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789445895.403701:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c02050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+25:11650:x1876369722145920:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 Request processed in 1132us (2766us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1789445895.403710:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 62 00000020:00080000:3.0:1789445895.403715:0:11955:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789445895.406209:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789445895.406223:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257027 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.406236:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988c00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445895.406240:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257027 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.406253:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257027 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.406272:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9afe8e97a000) 00010000:00010000:1.0:1789445895.406275:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789445895.406280:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257027 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.406286:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257027 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.406326:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445895.406328:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445895.406330:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445895.451488:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445895.452212:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722146048 00000100:00100000:3.0:1789445895.452223:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722146048 00000100:00100000:3.0:1789445895.452291:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 231 00000100:00100000:3.0:1789445895.452301:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+25:11653:x1876369722146048:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445895.452338:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445895.452359:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d4725702e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4eb0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.452430:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257035 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.452444:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257035 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.452455:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257035 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.452470:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d4725703c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.452477:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d4725703c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.452498:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d4725703c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.452762:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257043 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.452775:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256f4e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e71 expref: 26 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.452784:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257043 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.452821:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256f4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e71 expref: 26 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.452837:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256f4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e71 expref: 26 pid: 8204 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445895.452852:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9f1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742051712:192.168.206.59@tcp:104: 00000100:00100000:3.0:1789445895.453025:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afd82cb4780 going to sleep for 11 seconds 00000100:00100000:3.0:1789445895.468426:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9f1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876369742051712:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789445895.468455:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257043 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445895.468901:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445895.472278:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722146304 00000100:00100000:3.0:1789445895.472293:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722146304 00000100:00100000:3.0:1789445895.472379:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 63 00000100:00100000:3.0:1789445895.472389:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+27:5629:x1876369722146304:12345-192.168.206.59@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789445895.473143:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+28:5629:x1876369722146304:12345-192.168.206.59@tcp:35:ldlm_bl.0 Request processed in 752us (4240us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1789445895.473153:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 63 00000100:00100000:0.0:1789445895.481878:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445895.481969:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722146432 00000100:00100000:3.0:1789445895.481980:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722146432 00010000:00010000:3.0:1789445895.482021:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256f4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e71 expref: 28 pid: 8204 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445895.482092:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 87 00000100:00100000:3.0:1789445895.482102:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe87d86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+28:2374:x1876369722146432:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789445895.482119:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789445895.482136:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256f4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e71 expref: 28 pid: 8204 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.482150:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256f4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e71 expref: 28 pid: 8204 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.482173:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bfc00/0xc1b37c4d47256f4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e71 expref: 28 pid: 8204 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.482191:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:3.0:1789445895.482196:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257043 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.482206:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.482213:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257043 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445895.482264:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789445895.482395:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482403:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789445895.482449:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789445895.482453:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789445895.482470:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482482:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482490:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257035 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482496:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257035 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482502:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257035 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482507:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445895.482510:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257035 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482517:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257035 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482524:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:1.0:1789445895.482527:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445895.482530:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257035 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482543:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988c00/0xc1b37c4d47257035 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482553:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d4725703c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482558:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d4725703c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482563:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d4725703c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482568:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989000 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789445895.482570:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d4725703c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482575:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d4725703c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482582:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9afe8e97a900) 00010000:00010000:1.0:1789445895.482584:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789445895.482587:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d4725703c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482592:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989000/0xc1b37c4d4725703c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482632:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989200/0xc1b37c4d4725702e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4eb0 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482647:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257043 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4eb0 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445895.482674:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:1.0:1789445895.482676:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789445895.482679:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e988000, rc 0) 00000100:00100000:3.0:1789445895.484853:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe87d86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+27:2374:x1876369722146432:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 2741us (2974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445895.484866:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 87 00000100:00100000:1.0:1789445895.485021:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+26:11653:x1876369722146048:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 32719us (33544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445895.485030:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 231 00010000:00010000:2.0:1789445895.903730:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789445896.420741:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789445896.420752:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789445896.420814:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789445896.420821:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789445896.420978:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1876369742051840:192.168.206.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789445896.421115:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea485b240 going to sleep for 11 seconds 00000100:00100000:2.0:1789445896.427236:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1876369742051840:192.168.206.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789445896.442200:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445896.443269:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722146560 00000100:00100000:1.0:1789445896.443286:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722146560 00000100:00100000:1.0:1789445896.443461:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 232 00000100:00100000:1.0:1789445896.443476:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+26:11664:x1876369722146560:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789445896.443515:0:8204:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789445896.443815:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+26:11664:x1876369722146560:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 Request processed in 343us (1632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445896.443823:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 232 00000100:00100000:3.0:1789445896.449745:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445896.449829:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722146816 00000100:00100000:3.0:1789445896.449847:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722146816 00000100:00100000:3.0:1789445896.449957:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 233 00000100:00100000:3.0:1789445896.449973:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+26:11664:x1876369722146816:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789445896.450006:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445896.450036:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d4725704a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4eb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.450234:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47257051 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.450254:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47257051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.450271:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47257051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445896.450286:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789445896.450490:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d4725704a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4eb7 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.450515:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47257051 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4eb7 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.450543:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:3.0:1789445896.450548:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789445896.450553:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989600, rc 0) 00000100:00100000:3.0:1789445896.450640:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+28:11664:x1876369722146816:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 673us (920us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789445896.450650:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 233 00000100:00080000:0.0:1789445896.450717:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445896.458041:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445896.458121:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722147072 00000100:00100000:2.0:1789445896.458136:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722147072 00000100:00100000:2.0:1789445896.458218:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 234 00000100:00100000:2.0:1789445896.458231:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+28:11664:x1876369722147072:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789445896.458361:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725705f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445896.458386:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725705f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445896.458405:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725705f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445896.458820:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725705f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445896.458831:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725705f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445896.458839:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725705f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445896.458845:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789445896.458851:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725705f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445896.458862:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725705f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445896.458878:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:2.0:1789445896.458881:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789445896.458911:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725705f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445896.458918:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57bf600/0xc1b37c4d4725705f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445896.459163:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+29:11664:x1876369722147072:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 Request processed in 932us (1139us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789445896.459173:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 234 00000040:00080000:2.0:1789445896.459359:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789445896.459366:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1789445896.459384:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445896.459495:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722147200 00000100:00100000:0.0:1789445896.459513:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722147200 00000100:00100000:0.0:1789445896.459611:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 17 00000100:00100000:0.0:1789445896.459623:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+29:2377:x1876369722147200:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789445896.459642:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445896.459671:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989600/0xc1b37c4d47257051 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4eb7 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445896.459695:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:0.0:1789445896.459701:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445896.459775:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+28:2377:x1876369722147200:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 155us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445896.459783:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 17 00000040:00080000:2.0:1789445896.459937:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789445896.459948:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789445896.481464:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445896.481863:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722147456 00000100:00100000:3.0:1789445896.481882:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722147456 00000100:00100000:3.0:1789445896.482003:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 64 00000100:00100000:3.0:1789445896.482017:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+28:11664:x1876369722147456:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789445896.482911:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+29:11664:x1876369722147456:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 Request processed in 505us (1072us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789445896.482924:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 64 00000040:00080000:1.0:1789445896.609010:0:12552:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789445896.609022:0:12552:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789445896.609079:0:12552:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789445896.609084:0:12552:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789445896.751776:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445896.754616:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722147712 00000100:00100000:3.0:1789445896.754631:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722147712 00000100:00100000:3.0:1789445896.754686:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 235 00000100:00100000:3.0:1789445896.754697:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+29:11677:x1876369722147712:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:3.0:1789445896.754721:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445896.754739:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47257066 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ebe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.754836:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d4725706d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.754859:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d4725706d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.754870:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d4725706d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789445896.754882:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789445896.754997:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988800/0xc1b37c4d47257066 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ebe expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.755013:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d4725706d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ebe expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.755021:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:3.0:1789445896.755024:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789445896.755028:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989400, rc 0) 00000100:00100000:3.0:1789445896.755501:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+31:11677:x1876369722147712:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 422us (3351us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789445896.755511:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 235 00000100:00100000:0.0:1789445896.769684:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445896.769891:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722147840 00000100:00100000:3.0:1789445896.769900:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722147840 00000100:00100000:3.0:1789445896.769941:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 236 00000100:00100000:3.0:1789445896.769949:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+31:11677:x1876369722147840:12345-192.168.206.59@tcp:54:lfs.0 00010000:00010000:3.0:1789445896.770007:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d4725707b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.770024:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d4725707b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.770062:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d4725707b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.770088:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d4725707b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.770095:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d4725707b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.770103:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d4725707b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.770109:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789445896.770113:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d4725707b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.770122:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d4725707b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.770132:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:3.0:1789445896.770135:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789445896.770140:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d4725707b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445896.770147:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988e00/0xc1b37c4d4725707b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445896.770213:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+31:11677:x1876369722147840:12345-192.168.206.59@tcp:54:lfs.0 Request processed in 264us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445896.770221:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 236 00000100:00100000:3.0:1789445896.907993:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445896.908156:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722147968 00000100:00100000:0.0:1789445896.908172:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722147968 00000100:00100000:0.0:1789445896.908239:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 70 00000100:00100000:0.0:1789445896.908249:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2375:x1876369722147968:12345-192.168.206.59@tcp:101:cat.0 00010000:00010000:0.0:1789445896.908266:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445896.908286:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8cfa4f6/0xc1b37c4d47257082 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ec5 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789445896.908322:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa8c705, atime: 0x6aa8c705, ctime: 0x6aa8c705, blocks: 0xb 00010000:00010000:0.0:1789445896.908342:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=334s v=(0 0) 00010000:00010000:0.0:1789445896.908346:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445896.908356:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8cfa4f6/0xc1b37c4d47257082 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ec5 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445896.908377:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8cfa4f6/0xc1b37c4d47257082 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ec5 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445896.908392:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907600, rc 0) 00000100:00100000:0.0:1789445896.908457:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2375:x1876369722147968:12345-192.168.206.59@tcp:101:cat.0 Request processed in 209us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445896.908464:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 70 00000100:00100000:3.0:1789445896.913017:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445896.914092:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722148096 00000100:00100000:1.0:1789445896.914108:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722148096 00002000:00100000:1.0:1789445896.914166:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9afeb9f1c700 x1876369722148096/t0(0) o3->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:22/0 lens 488/0 e 0 to 0 dl 1789445907 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789445896.914178:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afeb9f1c700 with x1876369722148096 ext(0->4095) 00002000:00010000:1.0:1789445896.914184:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afeb9f1c700 00000100:00100000:1.0:1789445896.914215:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:1.0:1789445896.914242:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2374:x1876369722148096:12345-192.168.206.59@tcp:3:cat.0 00000100:00100000:1.0:1789445896.914509:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2374:x1876369722148096:12345-192.168.206.59@tcp:3:cat.0 Request processed in 268us (1505us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789445896.914517:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 7 00002000:00100000:1.0:1789445896.914523:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9afeb9f1c700 x1876369722148096/t0(0) o3->4a94602d-5f10-4cb2-abf8-c0de02603d85@192.168.206.59@tcp:22/0 lens 488/4536 e 0 to 0 dl 1789445907 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789445896.914532:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afeb9f1c700 with x1876369722148096 ext(0->4095) 00002000:00010000:1.0:1789445896.914535:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afeb9f1c700 00010000:00010000:3.0:1789445896.922285:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445897.308358:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742051968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789445897.308418:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445897.308527:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742051968 00000100:00100000:3.0:1789445897.308535:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742051968 00000100:00100000:3.0:1789445897.308610:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789445897.308619:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742051968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789445897.308648:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789445897.308690:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742051968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445897.308697:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789445897.308728:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789445897.308732:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afebf668e00, transno 4294967307 00000004:00080000:3.0:1789445897.308740:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1789445897.308756:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afeba62bb80, transno 4294967310 00000100:00100000:3.0:1789445897.308765:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742051968:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789445897.308822:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445897.762397:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445897.762450:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445897.762492:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445897.762515:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445897.762537:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445897.762566:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722148480 00000100:00100000:3.0:1789445897.762576:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722148480 00000100:00100000:3.0:1789445897.762625:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722148608 00000100:00100000:3.0:1789445897.762629:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722148608 00000100:00100000:3.0:1789445897.762669:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 90 00000100:00100000:3.0:1789445897.762681:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2375:x1876369722148480:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445897.762755:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2375:x1876369722148480:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 77us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445897.762773:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 90 00000100:00100000:3.0:1789445897.762790:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 91 00000100:00100000:3.0:1789445897.762796:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2375:x1876369722148608:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445897.763319:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+8:2375:x1876369722148608:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 509us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445897.763328:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 91 00000100:00100000:3.0:1789445897.763353:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722148736 00000100:00100000:3.0:1789445897.763358:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722148736 00000100:00100000:3.0:1789445897.763388:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722148352 00000100:00100000:3.0:1789445897.763391:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722148352 00000100:00100000:3.0:1789445897.763411:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 152 00000100:00100000:3.0:1789445897.763418:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:338e572d-37d9-47c3-87b6-4735cd889844+5:2375:x1876369722148736:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445897.763449:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:338e572d-37d9-47c3-87b6-4735cd889844+5:2375:x1876369722148736:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 32us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445897.763851:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722148224 00000100:00100000:0.0:1789445897.763856:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722148224 00000100:00100000:0.0:1789445897.763895:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 295 00000100:00100000:0.0:1789445897.763903:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2375:x1876369722148224:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445897.763946:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2375:x1876369722148224:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 44us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445897.763954:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 295 00000100:00080000:0.0:1789445897.763998:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789445897.764003:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789445897.764006:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445897.764295:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 152 00000100:00100000:3.0:1789445897.764323:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 153 00000100:00100000:3.0:1789445897.764332:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+31:2375:x1876369722148352:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:3.0:1789445897.764363:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+31:2375:x1876369722148352:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 34us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445897.764369:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 153 00010000:00010000:1.0:1789445897.946387:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789445898.525747:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789445898.525757:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789445898.525790:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789445898.525796:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789445898.970520:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445899.355154:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742052224:0@lo:400:kworker.0 00000100:00100000:1.0:1789445899.355234:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445899.355320:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742052736:0@lo:400:kworker.0 00000100:00100000:1.0:1789445899.355348:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445899.355382:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789445899.355388:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742052352:0@lo:400:kworker.0 00000100:00100000:1.0:1789445899.355411:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445899.355447:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742052736 00000100:00100000:1.0:1789445899.355470:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742052736 00000100:00100000:3.0:1789445899.355500:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742052480:0@lo:400:kworker.0 00000100:00100000:1.0:1789445899.355529:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789445899.355537:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445899.355542:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1876369742052736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445899.355568:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789445899.355576:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369742052096:0@lo:400:kworker.0 00000100:00100000:1.0:1789445899.355610:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1876369742052736:12345-0@lo:400:kworker.0 Request processed in 71us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445899.355619:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789445899.355631:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445899.355638:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742052480 00000100:00100000:1.0:1789445899.355643:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742052480 00000100:00100000:3.0:1789445899.355659:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369742052608:0@lo:400:kworker.0 00000100:00100000:1.0:1789445899.355682:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789445899.355688:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445899.355695:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742052480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445899.355738:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742052480:12345-0@lo:400:kworker.0 Request processed in 46us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445899.355745:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789445899.355766:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742052480:0@lo:400:kworker.0 00000100:00100000:1.0:1789445899.355768:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742052224 00000100:00100000:1.0:1789445899.355774:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742052224 00000100:00100000:2.0:1789445899.355869:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742052352 00000100:00100000:2.0:1789445899.355873:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742052352 00000100:00100000:2.0:1789445899.355899:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742052608 00000100:00100000:2.0:1789445899.355902:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742052608 00000100:00100000:2.0:1789445899.355918:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789445899.355924:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742052224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445899.355956:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742052224:12345-0@lo:400:kworker.0 Request processed in 33us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445899.355962:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789445899.355973:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789445899.355978:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742052352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445899.356014:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742052352:12345-0@lo:400:kworker.0 Request processed in 36us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445899.356020:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789445899.356036:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789445899.356041:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876369742052608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445899.356096:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876369742052608:12345-0@lo:400:kworker.0 Request processed in 55us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445899.356101:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789445899.356130:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369742052608:0@lo:400:kworker.0 00000100:00080000:0.0:1789445899.356571:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789445899.356577:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789445899.356580:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789445899.356597:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742052096 00000100:00100000:0.0:1789445899.356601:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742052096 00000100:00100000:0.0:1789445899.356642:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789445899.356651:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3310:x1876369742052096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445899.356695:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3310:x1876369742052096:12345-0@lo:400:kworker.0 Request processed in 46us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445899.356702:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789445899.356824:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369742052096:0@lo:400:kworker.0 00000100:00100000:0.0:1789445899.374009:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742052352:0@lo:400:kworker.0 00000100:00100000:0.0:1789445899.374032:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742052224:0@lo:400:kworker.0 00000100:00100000:0.0:1789445899.374076:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742052736:0@lo:400:kworker.0 00000100:00100000:1.0:1789445899.868433:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742052864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789445899.868502:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445899.868570:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742052864 00000100:00100000:1.0:1789445899.868578:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742052864 00000100:00100000:1.0:1789445899.868621:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789445899.868629:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876369742052864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789445899.868658:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445899.868694:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876369742052864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445899.868701:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789445899.868742:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742052864:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1789445899.868781:0:7985:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337890090966ns, next at 338890088228ns, rc = 0 00010000:00010000:3.0:1789445899.996359:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789445900.432894:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1789445900.432921:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000004:00080000:1.0:1789445900.442728:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000020:00080000:1.0:1789445900.442766:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1789445900.442799:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:1.0:1789445900.442811:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1789445900.442835:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9afd82cb4e40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789445900.442841:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afead9f9600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9afd82cb4f00 00000020:00080000:1.0:1789445900.442845:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afead9f9d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9afead8e5400 00000020:00080000:2.0:1789445900.442905:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789445900.443232:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1789445900.443548:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789445900.443983:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742052992:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789445900.444266:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445900.444712:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742052992 00000100:00100000:3.0:1789445900.444723:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742052992 00000100:00100000:3.0:1789445900.444823:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789445900.444835:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742052992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789445900.445361:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789445900.445366:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789445893 -> 1789445893 00002000:00010000:3.0:1789445900.445369:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1789445893 -> 1789445893 00002000:00010000:3.0:1789445900.445372:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789445893 -> 1789445893 00002000:00010000:3.0:1789445900.445375:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789445900.445462:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1876369742052992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 628us (1194us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789445900.445470:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789445900.445698:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1789445900.445706:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:2.0:1789445900.445736:0:3311:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9afeba62bb80 x1876369742052992/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789445916 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789445900.445751:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afeba62bb80/2, rc 0, transno 4294967324 00000100:00100000:2.0:1789445900.445757:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742052992:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1789445901.018921:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445902.045186:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445902.426381:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789445902.426410:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742053120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789445902.426488:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445902.426646:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742053120 00000100:00100000:1.0:1789445902.426655:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742053120 00000100:00100000:1.0:1789445902.426724:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789445902.426735:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742053120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789445902.426777:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445902.426830:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb575ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742053120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445902.426838:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789445902.426941:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742053120:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789445902.427006:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789445902.453803:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445902.453899:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722148864 00000100:00100000:2.0:1789445902.453910:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722148864 00000100:00100000:2.0:1789445902.453988:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 237 00000100:00100000:2.0:1789445902.453998:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:11338:x1876369722148864:12345-192.168.206.59@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789445902.454135:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:11338:x1876369722148864:12345-192.168.206.59@tcp:60:lhsmtool_posix.0 Request processed in 138us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445902.454156:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 237 00000100:00080000:0.0:1789445902.454269:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789445902.458945:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445902.459655:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722149120 00000100:00100000:1.0:1789445902.459665:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722149120 00000100:00100000:1.0:1789445902.459733:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 65 00000100:00100000:1.0:1789445902.459743:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:11338:x1876369722149120:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789445902.460799:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:11338:x1876369722149120:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 Request processed in 1048us (1854us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789445902.460811:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 65 00000100:00100000:1.0:1789445902.890724:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445902.890843:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445902.890875:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445902.890918:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445902.890979:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722149632 00000100:00100000:2.0:1789445902.890986:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722149504 00000100:00100000:1.0:1789445902.890993:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722149632 00000100:00100000:2.0:1789445902.891007:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722149504 00000100:00100000:1.0:1789445902.891120:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 157 00000100:00100000:2.0:1789445902.891136:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722149376 00000100:00100000:1.0:1789445902.891137:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:338e572d-37d9-47c3-87b6-4735cd889844+5:2374:x1876369722149632:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445902.891145:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722149376 00000100:00100000:2.0:1789445902.891186:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 94 00000100:00100000:2.0:1789445902.891212:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2374:x1876369722149504:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445902.891242:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:338e572d-37d9-47c3-87b6-4735cd889844+5:2374:x1876369722149632:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 110us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445902.891268:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 157 00000100:00100000:2.0:1789445902.891310:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2374:x1876369722149504:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 110us (462us total) trans 0 rc 0/0 00000100:00080000:1.0:1789445902.891319:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789445902.891321:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 94 00000100:00080000:1.0:1789445902.891328:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789445902.891334:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445902.891355:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 95 00000100:00100000:2.0:1789445902.891364:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2374:x1876369722149376:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445902.891400:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2374:x1876369722149376:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 36us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445902.891409:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 95 00000100:00100000:0.0:1789445902.891843:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722149248 00000100:00100000:0.0:1789445902.891861:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722149248 00000100:00100000:0.0:1789445902.891915:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 297 00000100:00100000:0.0:1789445902.891925:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2374:x1876369722149248:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445902.891964:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2374:x1876369722149248:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 42us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445902.891977:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 297 00010000:00010000:3.0:1789445903.066503:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445904.091569:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789445904.306972:0:12753:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 00:18:22 (1789445902) 00000100:00100000:2.0:1789445904.478175:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876369742053376:0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.478236:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445904.478294:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742053888:0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.478317:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445904.478346:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789445904.478352:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742053248:0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.478378:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445904.478625:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742053760:0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.478651:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445904.478691:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742053504:0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.478716:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445904.479108:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789445904.479116:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742053632:0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.479144:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445904.479177:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742053376 00000100:00100000:2.0:1789445904.479183:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742053376 00000100:00100000:2.0:1789445904.479223:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742053760 00000100:00100000:2.0:1789445904.479226:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742053760 00000100:00100000:2.0:1789445904.479246:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742053504 00000100:00100000:2.0:1789445904.479248:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742053504 00000100:00100000:2.0:1789445904.479288:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789445904.479296:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876369742053376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.479348:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876369742053376:12345-0@lo:400:kworker.0 Request processed in 52us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445904.479354:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789445904.479371:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789445904.479377:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742053760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.479956:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742053760:12345-0@lo:400:kworker.0 Request processed in 576us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445904.479965:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789445904.479981:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789445904.479989:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742053504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.480030:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742053504:12345-0@lo:400:kworker.0 Request processed in 43us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445904.480036:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789445904.480082:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742053888 00000100:00100000:2.0:1789445904.480098:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742053888 00000100:00100000:2.0:1789445904.480129:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742053632 00000100:00100000:2.0:1789445904.480132:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742053632 00000100:00100000:2.0:1789445904.480152:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789445904.480159:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81215880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876369742053888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.480191:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81215880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876369742053888:12345-0@lo:400:kworker.0 Request processed in 33us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445904.480198:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789445904.480209:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789445904.480214:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81214700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742053632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.480241:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81214700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742053632:12345-0@lo:400:kworker.0 Request processed in 27us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445904.480247:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789445904.480265:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742053248 00000100:00100000:2.0:1789445904.480269:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742053248 00000100:00100000:2.0:1789445904.480309:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789445904.480315:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742053248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.480348:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742053248:12345-0@lo:400:kworker.0 Request processed in 34us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445904.480354:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:2.0:1789445904.480410:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789445904.480414:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789445904.480416:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789445904.480456:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742053632:0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.480467:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742053504:0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.480496:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742053248:0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.480518:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742053760:0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.480848:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876369742053376:0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.480948:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742053888:0@lo:400:kworker.0 00000100:00100000:2.0:1789445904.998804:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742054016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789445904.998869:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445904.999001:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742054016 00000100:00100000:1.0:1789445904.999008:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742054016 00000100:00100000:1.0:1789445904.999115:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789445904.999125:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81215c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876369742054016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789445904.999157:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445904.999208:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81215c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876369742054016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445904.999216:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789445904.999306:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742054016:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789445905.121412:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789445905.561209:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1789445905.562711:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1789445905.562726:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1789445905.562773:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1789445905.562784:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1789445906.140845:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445906.744664:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445906.744778:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722149760 00000100:00100000:2.0:1789445906.744788:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722149760 00000100:00100000:2.0:1789445906.744862:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 238 00000100:00100000:2.0:1789445906.744873:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:338e572d-37d9-47c3-87b6-4735cd889844+5:12344:x1876369722149760:12345-192.168.206.59@tcp:101:lsof.0 00010000:00010000:2.0:1789445906.744893:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445906.744913:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47257089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ecc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445906.744972:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47257090 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445906.744986:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47257090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445906.744996:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47257090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789445906.745028:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789445906.745032:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789445906.745134:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47257090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445906.745162:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be800/0xc1b37c4d47257089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ecc expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445906.745180:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47257090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ecc expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445906.745189:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961000) 00010000:00010000:2.0:1789445906.745192:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789445906.745196:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57be400, rc 0) 00000100:00100000:2.0:1789445906.745248:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:338e572d-37d9-47c3-87b6-4735cd889844+6:12344:x1876369722149760:12345-192.168.206.59@tcp:101:lsof.0 Request processed in 377us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445906.745255:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 238 00000100:00080000:1.0:1789445906.745650:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789445907.162360:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445907.546382:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742054144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789445907.546455:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445907.546617:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742054144 00000100:00100000:3.0:1789445907.546641:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742054144 00000100:00100000:3.0:1789445907.546712:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789445907.546723:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742054144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789445907.546771:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789445907.546827:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742054144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445907.546834:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789445907.546879:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742054144:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789445907.547228:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445908.001701:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445908.001948:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445908.001995:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445908.002014:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445908.002090:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445908.002176:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722150144 00000100:00100000:0.0:1789445908.002176:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722150272 00000100:00100000:1.0:1789445908.002186:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722150144 00000100:00100000:0.0:1789445908.002186:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722150272 00000100:00100000:1.0:1789445908.002277:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 98 00000100:00100000:1.0:1789445908.002289:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2374:x1876369722150144:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445908.002369:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2374:x1876369722150144:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 83us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445908.002377:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 98 00000100:00100000:2.0:1789445908.003037:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722149888 00000100:00100000:2.0:1789445908.003117:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722149888 00000100:00100000:2.0:1789445908.003165:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 299 00000100:00100000:2.0:1789445908.003174:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2374:x1876369722149888:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445908.003223:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2374:x1876369722149888:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 51us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445908.003640:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722150400 00000100:00100000:1.0:1789445908.003646:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722150400 00000100:00100000:2.0:1789445908.003679:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 299 00000100:00100000:2.0:1789445908.003830:0:8204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722150016 00000100:00100000:2.0:1789445908.003834:0:8204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722150016 00000100:00100000:0.0:1789445908.008746:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 99 00000100:00100000:0.0:1789445908.008766:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2374:x1876369722150272:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789445908.008864:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2374:x1876369722150272:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 106us (6773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445908.008873:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 99 00000100:00080000:3.0:1789445908.016105:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789445908.016323:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789445908.016328:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789445908.018199:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 161 00000100:00100000:1.0:1789445908.018241:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+6:2374:x1876369722150400:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789445908.018363:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+6:2374:x1876369722150400:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 151us (16366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445908.018371:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 161 00000100:00100000:2.0:1789445908.022296:0:8204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 162 00000100:00100000:2.0:1789445908.022314:0:8204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:2374:x1876369722150016:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789445908.022413:0:8204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:2374:x1876369722150016:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 104us (20397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445908.022435:0:8204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 162 00000100:00100000:0.0:1789445908.044452:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445908.044569:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722150656 00000100:00100000:3.0:1789445908.044583:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722150656 00000100:00100000:3.0:1789445908.044669:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 66 00000100:00100000:3.0:1789445908.044683:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+18:12345:x1876369722150656:12345-192.168.206.59@tcp:35:umount.0 00000100:00100000:3.0:1789445908.045246:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:12345:x1876369722150656:12345-192.168.206.59@tcp:35:umount.0 Request processed in 563us (807us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789445908.045266:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 66 00000100:00100000:0.0:1789445908.051436:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445908.051579:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722150912 00000100:00100000:1.0:1789445908.051604:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722150912 00000100:00100000:1.0:1789445908.051684:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 67 00000100:00100000:1.0:1789445908.051696:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+19:12345:x1876369722150912:12345-192.168.206.59@tcp:35:umount.0 00000100:00100000:1.0:1789445908.052570:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:12345:x1876369722150912:12345-192.168.206.59@tcp:35:umount.0 Request processed in 870us (2341us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789445908.052582:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 67 00000100:00100000:1.0:1789445908.055553:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445908.055744:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722151168 00000100:00100000:0.0:1789445908.055757:0:11955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722151168 00000100:00100000:0.0:1789445908.055868:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 68 00000100:00100000:0.0:1789445908.055884:0:11955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4c01c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+20:12345:x1876369722151168:12345-192.168.206.59@tcp:35:umount.0 00000100:00100000:0.0:1789445908.056291:0:11955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4c01c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:12345:x1876369722151168:12345-192.168.206.59@tcp:35:umount.0 Request processed in 410us (752us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789445908.056322:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 68 00000100:00100000:3.0:1789445908.058937:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445908.059419:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722151424 00000100:00100000:1.0:1789445908.059433:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722151424 00000100:00100000:1.0:1789445908.059492:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 69 00000100:00100000:1.0:1789445908.059503:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:12345:x1876369722151424:12345-192.168.206.59@tcp:35:umount.0 00000100:00100000:1.0:1789445908.060233:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a94602d-5f10-4cb2-abf8-c0de02603d85+22:12345:x1876369722151424:12345-192.168.206.59@tcp:35:umount.0 Request processed in 725us (1307us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789445908.060244:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 69 00000100:00100000:3.0:1789445908.064932:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445908.064982:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445908.065006:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445908.065154:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445908.065281:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722151936 00000100:00100000:2.0:1789445908.065293:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722151936 00000100:00100000:2.0:1789445908.065352:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722152192 00000100:00100000:2.0:1789445908.065355:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722152192 00000100:00100000:2.0:1789445908.065374:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722152064 00000100:00100000:2.0:1789445908.065377:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722152064 00000100:00100000:2.0:1789445908.065392:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 18 00000100:00100000:2.0:1789445908.065403:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+15:2375:x1876369722151936:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445908.065440:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445908.065464:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81678800/0xc1b37c4d47256116 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a5e expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445908.065485:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445908.065605:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722151808 00000100:00100000:1.0:1789445908.065610:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722151808 00000100:00100000:1.0:1789445908.065647:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 72 00000100:00100000:1.0:1789445908.065655:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+7:2373:x1876369722151808:12345-192.168.206.59@tcp:9:umount.0 00000020:00000080:1.0:1789445908.065695:0:6684:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47256656 00000020:00010000:1.0:1789445908.065706:0:6684:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9afeb57d3000: total 0 00000100:00080000:1.0:1789445908.065712:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9afeb57d4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789445908.065758:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1789445908.066957:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+14:2375:x1876369722151936:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 1545us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445908.066971:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 18 00000100:00100000:2.0:1789445908.067010:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 19 00000100:00100000:2.0:1789445908.067022:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+13:2375:x1876369722152192:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445908.067041:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445908.067088:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afeb57bec00/0xc1b37c4d4725632a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b29 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445908.067104:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445908.067246:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2373:x1876369722151808:12345-192.168.206.59@tcp:9:umount.0 Request processed in 1591us (2329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445908.067268:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 72 00000100:00100000:1.0:1789445908.067334:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 20 00000100:00100000:1.0:1789445908.067344:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+12:2375:x1876369722152064:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789445908.067355:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445908.067367:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe8e988400/0xc1b37c4d4725607c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a26 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445908.067378:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445908.067400:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+11:2375:x1876369722152064:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 58us (2245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445908.067407:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 20 00000020:00010000:1.0:1789445908.067464:0:8445:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9afeb57d3000: total 0 00010000:00010000:1.0:1789445908.067508:0:8445:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9afeb57d3000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789445908.067561:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8cfa4f6/0xc1b37c4d47257082 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ec5 expref: 4 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445908.067607:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f36dd97/0xc1b37c4d472569f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cfe expref: 3 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445908.067624:0:8445:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9afeb57d3000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789445908.067651:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445908.067653:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445908.067655:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445908.072784:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2375:x1876369722152192:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 5745us (7756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445908.072802:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 19 00000100:00100000:0.0:1789445908.072998:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445908.073192:0:11692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722152320 00000100:00100000:2.0:1789445908.073206:0:11692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722152320 00000100:00100000:2.0:1789445908.073281:0:11692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 73 00000100:00100000:2.0:1789445908.073292:0:11692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+5:2373:x1876369722152320:12345-192.168.206.59@tcp:9:umount.0 00000020:00000080:2.0:1789445908.073334:0:11692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d472563ee 00000100:00080000:2.0:1789445908.073350:0:11692:0:(import.c:65:import_set_state_nolock()) ffff9afe91e40000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789445908.073587:0:11692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1789445908.078232:0:11692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a94602d-5f10-4cb2-abf8-c0de02603d85+2:2373:x1876369722152320:12345-192.168.206.59@tcp:9:umount.0 Request processed in 753us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445908.078266:0:11692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 73 00010000:00010000:2.0:1789445908.078338:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445908.082834:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445908.083006:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722153344 00000100:00100000:3.0:1789445908.083021:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722153344 00000100:00100000:3.0:1789445908.083246:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 239 00000100:00100000:3.0:1789445908.083271:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+22:2373:x1876369722153344:12345-192.168.206.59@tcp:39:umount.0 00000020:00000080:3.0:1789445908.083315:0:5841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d4725608a 00000020:00010000:3.0:1789445908.083332:0:5841:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9afeba782800: total 0 00000100:00080000:3.0:1789445908.083337:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9afeba786000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789445908.083674:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1789445908.084246:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a94602d-5f10-4cb2-abf8-c0de02603d85+21:2373:x1876369722153344:12345-192.168.206.59@tcp:39:umount.0 Request processed in 984us (1422us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789445908.084272:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 239 00000020:00010000:0.0:1789445908.085880:0:5830:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9afeba782800: total 0 00010000:00010000:0.0:1789445908.085962:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9afeba782800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789445908.086008:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:0.0:1789445908.086014:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789445908.086028:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be200/0xc1b37c4d472569b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ce9 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445908.086089:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:0.0:1789445908.086093:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789445908.086099:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e600/0xc1b37c4d472569dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cf7 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445908.086113:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:0.0:1789445908.086115:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789445908.086118:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6f200/0xc1b37c4d47256f63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4e78 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445908.086131:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:0.0:1789445908.086133:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789445908.086136:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988000/0xc1b37c4d47257043 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4eb0 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445908.086148:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961000) 00010000:00010000:0.0:1789445908.086151:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789445908.086154:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d47256a46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d13 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445908.086189:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:0.0:1789445908.086192:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789445908.086195:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fde00/0xc1b37c4d472566b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4c25 expref: 15 pid: 8204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445908.086209:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9afe90eacc00) 00010000:00010000:0.0:1789445908.086211:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789445908.086215:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be000/0xc1b37c4d47256354 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b37 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445908.086233:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9afe90eac700) 00010000:00010000:0.0:1789445908.086235:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789445908.086239:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fda00/0xc1b37c4d472568d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4cb1 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445908.086265:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9afe858f5f00) 00010000:00010000:0.0:1789445908.086268:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789445908.086273:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6ea00/0xc1b37c4d472563c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b53 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445908.086289:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9afe90eac200) 00010000:00010000:0.0:1789445908.086291:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789445908.086295:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989400/0xc1b37c4d4725706d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ebe expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445908.086310:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:0.0:1789445908.086312:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789445908.086324:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e800/0xc1b37c4d47256a62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4d1a expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445908.086340:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afe858f5c00) 00010000:00010000:0.0:1789445908.086342:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789445908.086345:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe91b6e400/0xc1b37c4d47256370 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b3e expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445908.086358:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9afe858f5e00) 00010000:00010000:0.0:1789445908.086359:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789445908.086362:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe813fd200/0xc1b37c4d47256d41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4dec expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445908.086375:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9afeba782800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789445908.086392:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445908.086394:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445908.086396:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445908.186424:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789445908.762424:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789445908.762438:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789445908.763377:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1789445908.763391:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789445909.210276:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445909.595486:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876369742054400:0@lo:400:kworker.0 00000100:00100000:3.0:1789445909.595553:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445909.595624:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742054912:0@lo:400:kworker.0 00000100:00100000:3.0:1789445909.595647:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445909.595676:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789445909.595682:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742054272:0@lo:400:kworker.0 00000100:00100000:3.0:1789445909.595706:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445909.595725:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742054784:0@lo:400:kworker.0 00000100:00100000:3.0:1789445909.595744:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445909.595767:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742054656:0@lo:400:kworker.0 00000100:00100000:3.0:1789445909.595801:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445909.595819:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789445909.595823:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afea4d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876369742054528:0@lo:400:kworker.0 00000100:00100000:3.0:1789445909.595840:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445909.595874:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742054272 00000100:00100000:3.0:1789445909.595881:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742054272 00000100:00100000:3.0:1789445909.595916:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789445909.595924:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742054272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445909.595966:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742054272:12345-0@lo:400:kworker.0 Request processed in 43us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445909.595973:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789445909.596003:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742054912 00000100:00100000:3.0:1789445909.596006:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742054912 00000100:00100000:3.0:1789445909.596034:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742054656 00000100:00100000:3.0:1789445909.596037:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742054656 00000100:00100000:3.0:1789445909.596081:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789445909.596087:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742054912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445909.596117:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742054912:12345-0@lo:400:kworker.0 Request processed in 31us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445909.596124:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789445909.596135:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789445909.596140:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742054656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445909.596167:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742054656:12345-0@lo:400:kworker.0 Request processed in 28us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445909.596173:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789445909.596204:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742054656:0@lo:400:kworker.0 00000100:00100000:3.0:1789445909.596240:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742054272:0@lo:400:kworker.0 00000100:00100000:3.0:1789445909.596260:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1789445909.596265:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afeba62bb80, transno 4294967324 00000100:00100000:3.0:1789445909.596274:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742054912:0@lo:400:kworker.0 00000100:00080000:3.0:1789445909.596291:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789445909.596295:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789445909.596449:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742054400 00000100:00100000:1.0:1789445909.596453:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742054400 00000100:00100000:1.0:1789445909.596485:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742054784 00000100:00100000:1.0:1789445909.596487:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742054784 00000100:00100000:1.0:1789445909.596506:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742054528 00000100:00100000:1.0:1789445909.596509:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742054528 00000100:00100000:1.0:1789445909.596522:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789445909.596529:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9192d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876369742054400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445909.596568:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9192d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876369742054400:12345-0@lo:400:kworker.0 Request processed in 39us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445909.596574:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789445909.596599:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876369742054400:0@lo:400:kworker.0 00000100:00080000:1.0:1789445909.596624:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789445909.596632:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789445909.596639:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742054784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445909.596670:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742054784:12345-0@lo:400:kworker.0 Request processed in 33us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445909.596676:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789445909.596699:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742054784:0@lo:400:kworker.0 00000100:00100000:1.0:1789445909.596716:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789445909.596723:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876369742054528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445909.596752:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876369742054528:12345-0@lo:400:kworker.0 Request processed in 30us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445909.596764:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789445909.598091:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afea4d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876369742054528:0@lo:400:kworker.0 00000100:00100000:3.0:1789445909.958164:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445909.960095:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722153472 00000100:00100000:1.0:1789445909.960110:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722153472 00000100:00100000:1.0:1789445909.960185:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 21 00000100:00100000:1.0:1789445909.960195:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afea4d43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2377:x1876369722153472:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789445909.960210:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445909.960312:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe8e988200/0xc1b37c4d4725615c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a73 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445909.960331:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445909.961274:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afea4d43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:2377:x1876369722153472:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 1075us (3114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445909.961285:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 21 00000100:00100000:3.0:1789445909.968460:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445909.968615:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445909.969158:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722153600 00000100:00100000:2.0:1789445909.969168:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722153600 00000100:00100000:2.0:1789445909.969230:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722153856 00000100:00100000:2.0:1789445909.969234:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722153856 00000100:00100000:2.0:1789445909.969272:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 22 00000100:00100000:2.0:1789445909.969282:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eea72feb-e69e-4b1c-9967-d4ce1a915b88+10:2376:x1876369722153600:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445909.969298:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445909.969319:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe91b6fc00/0xc1b37c4d47256323 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4b22 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445909.969338:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445909.969405:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eea72feb-e69e-4b1c-9967-d4ce1a915b88+9:2376:x1876369722153600:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 125us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445909.969413:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 22 00000100:00100000:2.0:1789445909.969432:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 23 00000100:00100000:2.0:1789445909.969439:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe87d84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eea72feb-e69e-4b1c-9967-d4ce1a915b88+8:2374:x1876369722153856:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789445909.969465:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789445909.969474:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe8e988a00/0xc1b37c4d47256163 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a9d expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445909.969484:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789445909.969503:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe87d84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eea72feb-e69e-4b1c-9967-d4ce1a915b88+7:2374:x1876369722153856:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 65us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445909.969832:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 23 00000100:00100000:3.0:1789445909.977306:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445909.977386:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722153984 00000100:00100000:1.0:1789445909.977414:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722153984 00000100:00100000:1.0:1789445909.977489:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 240 00000100:00100000:1.0:1789445909.977501:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+6:2373:x1876369722153984:12345-192.168.206.59@tcp:39:umount.0 00000020:00000080:1.0:1789445909.977554:0:5842:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47256171 00000020:00010000:1.0:1789445909.977563:0:5842:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9afeba7a7800: total 0 00000100:00080000:1.0:1789445909.977568:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9afeba7a5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789445909.977595:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:0.0:1789445909.977955:0:5830:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9afeba7a7800: total 0 00010000:00010000:0.0:1789445909.977965:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445909.978036:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:338e572d-37d9-47c3-87b6-4735cd889844+5:2373:x1876369722153984:12345-192.168.206.59@tcp:39:umount.0 Request processed in 536us (743us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1789445909.978076:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 240 00010000:00010000:0.0:1789445909.978681:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9afeba7a7800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789445909.978717:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961000) 00010000:00010000:0.0:1789445909.978721:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789445909.978742:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb57be400/0xc1b37c4d47257090 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ecc expref: 4 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445909.978766:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9afeba7a7800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789445909.978778:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445909.978780:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445909.978782:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445910.001456:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445910.001640:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722154240 00000100:00100000:2.0:1789445910.001656:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722154240 00000100:00100000:2.0:1789445910.001744:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 301 00000100:00100000:2.0:1789445910.001761:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe83272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+7:2373:x1876369722154240:12345-192.168.206.59@tcp:251:umount.0 00000020:00000080:2.0:1789445910.001843:0:5836:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47256067 00000020:00010000:2.0:1789445910.001856:0:5836:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9afebfa48000: total 0 00000100:00080000:2.0:1789445910.001862:0:5836:0:(import.c:65:import_set_state_nolock()) ffff9afebfa49800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789445910.001966:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe83272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eea72feb-e69e-4b1c-9967-d4ce1a915b88+3:2373:x1876369722154240:12345-192.168.206.59@tcp:251:umount.0 Request processed in 208us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445910.001975:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 301 00000020:00010000:1.0:1789445910.003379:0:8445:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9afebfa48000: total 0 00010000:00010000:1.0:1789445910.003489:0:8445:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9afebfa48000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789445910.003538:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81678600/0xc1b37c4d4725611d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4a65 expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445910.003558:0:8445:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9afebfa48000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789445910.003570:0:8445:0:(genops.c:885:class_export_put()) final put ffff9afebfa48000/eea72feb-e69e-4b1c-9967-d4ce1a915b88 00010000:00010000:1.0:1789445910.003593:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445910.003596:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445910.003598:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789445910.004999:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afebfa48000/eea72feb-e69e-4b1c-9967-d4ce1a915b88 for MGS 00000020:00000080:0.0:1789445910.005206:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afebfa49800 for MGS 00000100:00100000:2.0:1789445910.107540:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742055040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789445910.107654:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445910.108000:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742055040 00000100:00100000:0.0:1789445910.108011:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742055040 00000100:00100000:0.0:1789445910.108119:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789445910.108132:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742055040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789445910.108187:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789445910.108271:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742055040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445910.108279:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789445910.108579:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba62bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742055040:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789445910.237734:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789445910.651257:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4a94602d-5f10-4cb2-abf8-c0de02603d85 00000020:00000080:2.0:1789445910.651271:0:6708:0:(genops.c:885:class_export_put()) final put ffff9afe91e44800/4a94602d-5f10-4cb2-abf8-c0de02603d85 00000020:00000080:2.0:1789445910.651310:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe91e44800/4a94602d-5f10-4cb2-abf8-c0de02603d85 for lustre-OST0000 00000020:00000080:2.0:1789445910.651365:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afe91e40000 for lustre-OST0000 00000001:00080000:1.0:1789445910.685500:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:1.0:1789445910.685526:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 338e572d-37d9-47c3-87b6-4735cd889844 00000001:00080000:1.0:1789445910.685534:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1789445910.685538:0:5862:0:(genops.c:885:class_export_put()) final put ffff9afeba7a7800/338e572d-37d9-47c3-87b6-4735cd889844 00000001:00080000:1.0:1789445910.685553:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1789445910.685581:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4a94602d-5f10-4cb2-abf8-c0de02603d85 00000001:00080000:1.0:1789445910.685589:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1789445910.685593:0:5862:0:(genops.c:885:class_export_put()) final put ffff9afeba782800/4a94602d-5f10-4cb2-abf8-c0de02603d85 00000020:00000080:1.0:1789445910.686347:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afeba7a7800/338e572d-37d9-47c3-87b6-4735cd889844 for lustre-MDT0000 00000020:00000080:1.0:1789445910.686440:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afeba782800/4a94602d-5f10-4cb2-abf8-c0de02603d85 for lustre-MDT0000 00000020:00000080:1.0:1789445910.686484:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afeba7a5800 for lustre-MDT0000 00000020:00000080:1.0:1789445910.686490:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afeba786000 for lustre-MDT0000 00000001:00100000:0.0:1789445910.712875:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4a94602d-5f10-4cb2-abf8-c0de02603d85 00000020:00000080:0.0:1789445910.712899:0:7638:0:(genops.c:885:class_export_put()) final put ffff9afeb57d3000/4a94602d-5f10-4cb2-abf8-c0de02603d85 00000020:00000080:3.0:1789445910.714716:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9afeb57d3000/4a94602d-5f10-4cb2-abf8-c0de02603d85 for lustre-OST0001 00000020:00000080:3.0:1789445910.720678:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afeb57d4000 for lustre-OST0001 00010000:00010000:2.0:1789445911.269873:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789445912.070533:0:12956:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789445912.093173:0:12956:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789445912.093257:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445912.093276:0:12956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472560f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445912.093284:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d472560f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445912.093292:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d472560f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445912.093313:0:12956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789445912.093338:0:12956:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789445912.093372:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789445912.093378:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789445912.093386:0:12956:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789445912.095799:0:12956:0:(import.c:65:import_set_state_nolock()) ffff9afe8533d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789445912.096009:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876369742055168:0@lo:39:umount.0 00010000:00010000:1.0:1789445912.096275:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789445912.096289:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d472560f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445912.096301:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81678e00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:1.0:1789445912.096306:0:8445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d472560f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445912.096335:0:8445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1b37c4d472560f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789445912.096344:0:8445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1b37c4d472560f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445912.096351:0:8445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789445912.096354:0:8445:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789445912.096359:0:8445:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789445912.096413:0:8445:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d472560f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445912.096421:0:8445:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789445912.098187:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742055296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789445912.098288:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789445912.099100:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d472560f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445912.099125:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81678e00/0xc1b37c4d472560ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d472560f3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445912.099146:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445912.099149:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445912.099152:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445912.099195:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742055296 00000100:00100000:1.0:1789445912.099205:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742055296 00000100:00100000:1.0:1789445912.099307:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789445912.099322:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3311:x1876369742055296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789445912.099340:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445912.099361:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe8e989c00/0xc1b37c4d472560f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1b37c4d472560ec expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445912.099398:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445912.101152:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:3311:x1876369742055296:12345-0@lo:103:ldlm_bl.0 Request processed in 1824us (2854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445912.101172:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789445912.104132:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445912.104368:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742055168 00000100:00100000:3.0:1789445912.104382:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742055168 00000100:00100000:3.0:1789445912.104440:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789445912.104452:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876369742055168:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789445912.104492:0:5840:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255e84 00000100:00080000:3.0:1789445912.104504:0:5840:0:(import.c:65:import_set_state_nolock()) ffff9afeb9fcc800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789445912.104851:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445912.105164:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1876369742055168:12345-0@lo:39:umount.0 Request processed in 713us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445912.105175:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:3.0:1789445912.105188:0:5840:0:(genops.c:885:class_export_put()) final put ffff9afeb9fcc000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789445912.105227:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afeb9fcc000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789445912.105298:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afeb9fcc800 for lustre-MDT0000 00000100:00080000:3.0:1789445912.105344:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afe8533d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789445912.105355:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876369742055168:0@lo:39:umount.0 00000100:00080000:2.0:1789445912.105789:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789445912.105795:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789445912.105800:0:12956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1789445912.106099:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742055296:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789445912.110212:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256101 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445912.110250:0:12956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47256101 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445912.110259:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d47256101 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445912.110267:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d47256101 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445912.110339:0:12956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789445912.110347:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256028 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445912.110373:0:12956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47256028 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445912.110379:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d47256028 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445912.110386:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d47256028 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445912.110809:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789445912.110819:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d47256101 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445912.110828:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81679c00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1789445912.110833:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d47256101 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445912.110842:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1b37c4d47256101 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789445912.110850:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1b37c4d47256101 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445912.110856:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789445912.110858:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1789445912.110912:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d47256101 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445912.110919:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789445912.110958:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d47256101 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445912.110966:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81679c00/0xc1b37c4d472560fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d47256101 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445912.110992:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445912.110996:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d47256028 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445912.111002:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81679800 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1789445912.111006:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d47256028 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445912.111012:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1b37c4d47256028 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789445912.111019:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1b37c4d47256028 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445912.111024:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789445912.111027:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1789445912.111040:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d47256028 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445912.111080:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789445912.111088:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d47256028 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445912.111096:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445912.111098:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445912.111100:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445912.111224:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742055552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789445912.111323:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445912.111391:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789445912.111398:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742055424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789445912.111424:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445912.111459:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742055552 00000100:00100000:1.0:1789445912.111468:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742055552 00000100:00100000:1.0:1789445912.111521:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742055424 00000100:00100000:1.0:1789445912.111525:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742055424 00000100:00100000:1.0:1789445912.111550:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789445912.111559:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba629500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+19:3313:x1876369742055552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789445912.111593:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445912.111610:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81505e00/0xc1b37c4d47256028 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1b37c4d47256021 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445912.111640:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445912.111686:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba629500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+18:3313:x1876369742055552:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445912.111693:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789445912.111713:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789445912.111720:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+17:3313:x1876369742055424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789445912.111738:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445912.111748:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afeb57bf800/0xc1b37c4d47256101 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1b37c4d472560fa expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445912.111757:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445912.111782:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:3313:x1876369742055424:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445912.111789:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789445912.111837:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742055424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789445912.111847:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742055552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789445912.112533:0:12956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789445912.112549:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81679800/0xc1b37c4d47256021 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d47256028 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445912.112586:0:12956:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789445912.112602:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725631c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445912.112612:0:12956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d4725631c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445912.112618:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d4725631c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445912.112635:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d4725631c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445912.112894:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789445912.112902:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d4725631c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445912.112910:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bfa00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:1.0:1789445912.112914:0:8445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d4725631c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445912.112923:0:8445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1b37c4d4725631c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789445912.112932:0:8445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1b37c4d4725631c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445912.112937:0:8445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789445912.112940:0:8445:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789445912.112976:0:8445:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d4725631c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445912.112998:0:8445:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789445912.113034:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d4725631c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445912.113187:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789445912.113206:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742055680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789445912.113282:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789445912.113460:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445912.113463:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445912.113465:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445912.113478:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742055680 00000100:00100000:1.0:1789445912.113486:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742055680 00000100:00100000:1.0:1789445912.113540:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789445912.113549:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+16:3311:x1876369742055680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789445912.113577:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445912.113592:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe91b6f600/0xc1b37c4d4725631c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1b37c4d47256315 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445912.113607:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445912.113822:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:3311:x1876369742055680:12345-0@lo:103:ldlm_bl.0 Request processed in 274us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445912.113831:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789445912.113915:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742055680:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789445912.114314:0:12956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789445912.114323:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d47256315 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d4725631c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445912.114358:0:12956:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789445912.114370:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81504600/0xc1b37c4d47255dd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47255ddc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445912.114378:0:12956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81504600/0xc1b37c4d47255dd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47255ddc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445912.114386:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81504600/0xc1b37c4d47255dd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d47255ddc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445912.114394:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.159@tcp lock: ffff9afe81504600/0xc1b37c4d47255dd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d47255ddc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445912.114441:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445912.114450:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81504600/0xc1b37c4d47255dd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d47255ddc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445912.114469:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81504600 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1789445912.114472:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81504600/0xc1b37c4d47255dd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d47255ddc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445912.114481:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81504600/0xc1b37c4d47255dd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1b37c4d47255ddc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789445912.114488:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81504600/0xc1b37c4d47255dd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1b37c4d47255ddc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445912.114494:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789445912.114497:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1789445912.114523:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe81504600/0xc1b37c4d47255dd5 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d47255ddc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445912.114529:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789445912.114590:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742055808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789445912.114657:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445912.114734:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742055808 00000100:00100000:1.0:1789445912.114742:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742055808 00000100:00100000:1.0:1789445912.114782:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789445912.114791:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+15:3311:x1876369742055808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789445912.114803:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445912.114817:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe813fca00/0xc1b37c4d47255ddc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1b37c4d47255dd5 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445912.114835:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789445912.114996:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81504600/0xc1b37c4d47255dd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d47255ddc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445912.115008:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445912.115009:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445912.115011:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445912.115421:0:12956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789445912.115431:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81504600/0xc1b37c4d47255dd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d47255ddc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445912.115450:0:12956:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1789445912.115456:0:12956:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1789445912.115459:0:12956:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789445912.115521:0:12956:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789445912.115527:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789445912.115534:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789445912.115542:0:12956:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1789445912.115549:0:12956:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9afeba7a1000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789445912.115555:0:12956:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9afebfa33800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789445912.115579:0:12956:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9afeb5c80000) has exports, disconnecting them 00000020:00080000:0.0:1789445912.115585:0:12956:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9afeba7a1000), last request at 1789445909 00000020:00000080:0.0:1789445912.115603:0:12956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255fe9 00010000:00010000:2.0:1789445912.115828:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789445912.115854:0:12956:0:(import.c:65:import_set_state_nolock()) ffff9afeba7a4000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789445912.115932:0:12956:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afeba7a1000): rc 0 00000020:00000080:0.0:1789445912.115935:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afeba7a1000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789445912.115950:0:12956:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9afebfa33800), last request at 1789445909 00000020:00000080:0.0:1789445912.115955:0:12956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255f1e 00000100:00080000:0.0:1789445912.115961:0:12956:0:(import.c:65:import_set_state_nolock()) ffff9afebfa37000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789445912.115970:0:12956:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afebfa33800): rc 0 00000020:00000080:0.0:1789445912.115972:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afebfa33800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1789445912.115984:0:12956:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb24d417f7ae0 00000100:00080000:0.0:1789445912.116011:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789445912.116017:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1789445912.116034:0:12956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789445912.116263:0:12956:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789445912.116288:0:12956:0:(import.c:65:import_set_state_nolock()) ffff9afeb536e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789445912.116305:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789445912.116308:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1789445912.116318:0:12956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789445912.116378:0:12956:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789445912.116389:0:12956:0:(import.c:65:import_set_state_nolock()) ffff9afebf739800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789445912.116428:0:12956:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9afeb5c80000) has no exports 00010000:00010000:2.0:1789445912.116621:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445912.116639:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445912.116954:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a74a4946-2de5-4f94-9e7c-96ec5d765e2c+14:3311:x1876369742055808:12345-0@lo:103:ldlm_bl.0 Request processed in 2159us (2292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445912.116968:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000020:00000080:2.0:1789445912.117224:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9afeba7a1000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789445912.117298:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9afebfa33800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789445912.117326:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afeba7a4000 for lustre-MDT0000 00000020:00000080:2.0:1789445912.117332:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afebfa37000 for lustre-MDT0000 00000100:00100000:1.0:1789445912.117433:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742055936:0@lo:9:umount.0 00000100:00100000:1.0:1789445912.117510:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445912.117552:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742056064:0@lo:9:umount.0 00000100:00100000:1.0:1789445912.117814:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445912.117861:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742055936 00000100:00100000:1.0:1789445912.117927:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742055936 00000100:00100000:1.0:1789445912.117987:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742056064 00000100:00100000:1.0:1789445912.117990:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742056064 00000100:00100000:1.0:1789445912.118017:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789445912.118026:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876369742055936:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789445912.118155:0:6684:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255f6b 00000100:00080000:1.0:1789445912.118166:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9afeb5369000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789445912.118210:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1789445912.119499:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3309:x1876369742055936:12345-0@lo:9:umount.0 Request processed in 1465us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445912.119513:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789445912.119542:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789445912.119553:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876369742056064:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789445912.119949:0:6684:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47256060 00000100:00080000:1.0:1789445912.119961:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9afebfa4a800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1789445912.120109:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afeb536e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789445912.120129:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789445912.120132:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789445912.120136:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742055936:0@lo:9:umount.0 00000001:00000004:1.0:1789445912.120267:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789445912.121095:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3311:1876369742055808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789445912.121345:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3309:x1876369742056064:12345-0@lo:9:umount.0 Request processed in 1794us (3528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445912.121358:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1789445912.121412:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789445912.121418:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789445912.122432:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afebf739800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789445912.122461:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789445912.122463:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789445912.122468:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742056064:0@lo:9:umount.0 00010000:00010000:2.0:1789445912.122800:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445912.123215:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789445912.124616:0:12956:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9afeb5c80000) has no exports 00000020:00000080:0.0:1789445912.197415:0:12956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255e30 00000020:00000080:0.0:1789445912.197435:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afe9ee6c800/lustre-QMT0000_UUID 00000020:01000000:0.0:1789445912.197462:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789445912.197948:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe9ee6c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789445912.198428:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789445912.198443:0:12956:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789445912.198449:0:12956:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9afe9f923380) has no exports 00000020:00000080:1.0:1789445912.200341:0:12956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255e29 00000020:00000080:1.0:1789445912.200360:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afe9f935800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789445912.200433:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe9f935800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789445912.200821:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789445912.200834:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789445912.200838:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afead8c4000/lustre-QMT0000_UUID 00000020:00000080:1.0:1789445912.200842:0:12956:0:(genops.c:844:class_export_destroy()) destroying export ffff9afead8c4000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789445912.200855:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1789445912.201368:0:12956:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afe830020c0 - data ffff9afebfc2c288/ffff9afeb54f5800 00000020:01000000:1.0:1789445912.201551:0:12956:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afeb4f89420 - data ffff9afeaf36aa20/ffff9afeb5002000 00000001:00000004:1.0:1789445912.220269:0:12956:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:0.0:1789445912.295324:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789445912.395514:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789445912.395526:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1789445912.395553:0:12956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789445912.395556:0:12956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789445912.396955:0:7070:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789445912.396964:0:7070:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789445912.396979:0:7070:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789445912.399017:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789445912.399029:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1789445912.399082:0:12956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789445912.399086:0:12956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789445912.399759:0:7983:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789445912.399767:0:7983:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1789445912.399784:0:7983:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789445912.598794:0:12956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255df8 00000020:00000080:3.0:1789445912.598824:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afeb5c8c000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789445912.602299:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afeb5c8c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789445912.602720:0:12956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255e0d 00000020:00000080:0.0:1789445912.602735:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afeb5c8b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789445912.602786:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789445912.602797:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789445912.602809:0:12956:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789445912.602823:0:12956:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9afeb5c84d40) has no exports 00000004:01000000:0.0:1789445912.603070:0:12956:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789445912.603083:0:12956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d4725604b 00000020:00000080:0.0:1789445912.603088:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afebfa4f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789445912.603332:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afeb5c8b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789445912.603408:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789445912.603415:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789445912.603425:0:12956:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789445912.603429:0:12956:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9afeb9e54d40) has no exports 00000020:00000080:0.0:1789445912.603439:0:12956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47256044 00000020:00000080:0.0:1789445912.603445:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afebf73a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789445912.603470:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afebfa4f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1789445912.604503:0:12956:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789445912.604514:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789445912.604519:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1789445912.604528:0:12956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789445912.604531:0:12956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789445912.604785:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afebf73a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789445912.604999:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789445912.605026:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789445912.605035:0:12956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255f64 00000020:00000080:0.0:1789445912.605071:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afebf738800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789445912.605245:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afebf739800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789445912.605254:0:36:0:(genops.c:885:class_export_put()) final put ffff9afebfa4a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789445912.605257:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afebfa4a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789445912.605263:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789445912.605407:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789445912.605413:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789445912.605419:0:12956:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789445912.605424:0:12956:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9afeba50b380) has no exports 00000020:00000080:0.0:1789445912.605429:0:12956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255f5d 00000020:00000080:0.0:1789445912.605434:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afe9ee52800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789445912.605451:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afebf738800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789445912.606150:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe9ee52800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789445912.606701:0:12956:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789445912.606708:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789445912.606712:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1789445912.606721:0:12956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789445912.606723:0:12956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789445912.606837:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789445912.606849:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789445912.606901:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789445912.606905:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789445912.606911:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afe8533a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789445912.606914:0:12956:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe8533a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789445912.606921:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789445912.607320:0:12956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255e14 00000020:00000080:0.0:1789445912.607329:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afeb5c8c800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789445912.607450:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afeb536e800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789445912.607458:0:36:0:(genops.c:885:class_export_put()) final put ffff9afe9ee53800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789445912.607461:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe9ee53800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789445912.607477:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789445912.607794:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789445912.607801:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789445912.607808:0:12956:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789445912.607855:0:12956:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9afeb5c819c0) has no exports 00000020:00000080:0.0:1789445912.607890:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789445912.607895:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789445912.607900:0:12956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255e1b 00000020:00000080:0.0:1789445912.607905:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afeb5c8d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789445912.607969:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afeb5c8c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789445912.607974:0:36:0:(genops.c:885:class_export_put()) final put ffff9afeb5c8e800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789445912.607976:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afeb5c8e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789445912.607980:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1789445912.608341:0:12956:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afe9d560800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789445912.608352:0:12956:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afe9d560800 3 00000020:01000004:0.0:1789445912.608356:0:12956:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9afe9d560800 from lustre-MDT0000 00000020:00000080:0.0:1789445912.608384:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789445912.608389:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789445912.608392:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afeb5c89000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789445912.608395:0:12956:0:(genops.c:844:class_export_destroy()) destroying export ffff9afeb5c89000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789445912.608405:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789445912.608452:0:12956:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1789445912.608456:0:12956:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789445912.608459:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789445912.608494:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789445912.608498:0:12956:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789445912.608505:0:12956:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9afea4a1d800 a74a4946-2de5-4f94-9e7c-96ec5d765e2c 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789445912.608512:0:12956:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9afea4f93380) has exports, disconnecting them 00000020:00080000:0.0:1789445912.608517:0:12956:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9afea4a1d800), last request at 1789445693 00000020:00000080:0.0:1789445912.608535:0:12956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255db9 00000020:00010000:0.0:1789445912.608540:0:12956:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9afea4a1d800: total 1 00000100:00080000:0.0:1789445912.608546:0:12956:0:(import.c:65:import_set_state_nolock()) ffff9afea4a1e800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789445912.608564:0:12956:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afea4a1d800): rc 0 00000020:00010000:3.0:1789445912.608648:0:5829:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9afea4a1d800: total 1 00010000:00010000:3.0:1789445912.608692:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9afea4a1d800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1789445912.608724:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81678000/0xc1b37c4d4725610f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1b37c4d47256108 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445912.608744:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe91b6f400/0xc1b37c4d4725630e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1b37c4d47256307 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445912.608755:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe91b6f000/0xc1b37c4d47256300 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1b37c4d472562f9 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445912.608772:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe8e989e00/0xc1b37c4d47255ed1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1b37c4d47255eca expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445912.608784:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81679400/0xc1b37c4d472560c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1b37c4d472560c2 expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445912.608796:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81679200/0xc1b37c4d472560d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1b37c4d472560d0 expref: 4 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445912.608825:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe813fcc00/0xc1b37c4d472560bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1b37c4d472560b4 expref: 3 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445912.608837:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe81678c00/0xc1b37c4d472560e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1b37c4d472560de expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445912.608848:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9afea4a1d800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1789445912.608861:0:5829:0:(genops.c:885:class_export_put()) final put ffff9afea4a1d800/a74a4946-2de5-4f94-9e7c-96ec5d765e2c 00000020:00080000:0.0:1789445912.608961:0:12956:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9afea4f93380) has no exports 00000100:00100000:0.0:1789445912.609035:0:5835:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9afe8577fe00:5835] 1 exiting: rc = 0 00000020:00000080:1.0:1789445912.609566:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afeb5c8d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1789445912.609607:0:5834:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9afe919b7c00:5834] 0 exiting: rc = 1 00010000:00010000:3.0:1789445912.609799:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445912.609801:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445912.609803:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789445912.609923:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afea4a1d800/a74a4946-2de5-4f94-9e7c-96ec5d765e2c for MGS 00000020:00000080:1.0:1789445912.610010:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afea4a1e800 for MGS 00000100:00100000:0.0:1789445912.610182:0:5836:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9afe8577ea00:5836] 2 exiting: rc = 0 00000100:00100000:1.0:1789445912.610319:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610329:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610335:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610342:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610349:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610355:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610363:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610370:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610375:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610383:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610389:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610397:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610405:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610409:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610415:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610420:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610426:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610433:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610438:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610443:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610449:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610455:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610462:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610564:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610688:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610697:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610703:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610710:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610717:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610723:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610730:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610737:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610742:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610748:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610754:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610758:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610764:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610769:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610776:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610781:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610786:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610791:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610796:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610801:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610807:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610940:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610950:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610957:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610964:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610970:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610977:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610983:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610988:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610993:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.610999:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.611005:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.611012:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.611018:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.611034:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.611203:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.611213:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.611221:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.611228:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.611246:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789445912.612360:0:12956:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789445912.612367:0:12956:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1789445912.615411:0:12956:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afeb548d900 - data ffff9afeae2d11b0/ffff9afeba79fc00 00000020:01000000:0.0:1789445912.615788:0:12956:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afe90eb0f00 - data ffff9afeaf3e3e58/ffff9afea4ec9c00 00000020:00000080:1.0:1789445912.616823:0:12956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255d9d 00000020:00000080:1.0:1789445912.616838:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afea4d2f000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789445912.616863:0:12956:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afe9d560800 from MGS, refs=2 00000020:01000004:1.0:1789445912.616867:0:12956:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afe9d560800 2 00000020:01000004:1.0:1789445912.616941:0:12956:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9afe9d560800 from MGS 00000020:00000080:1.0:1789445912.616978:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789445912.616988:0:12956:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789445912.616991:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afe87db6000/MGS 00000020:00000080:1.0:1789445912.616995:0:12956:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe87db6000/MGS for MGS 00000020:01000000:1.0:1789445912.617004:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789445912.617113:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789445912.617119:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789445912.617125:0:12956:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789445912.617134:0:12956:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9afe9fa2a000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789445912.617141:0:12956:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9afe85c399c0) has exports, disconnecting them 00000020:00080000:1.0:1789445912.617147:0:12956:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9afe9fa2a000), last request at 1789445694 00000020:00000080:1.0:1789445912.617153:0:12956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255e68 00000020:00080000:1.0:1789445912.617168:0:12956:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afe9fa2a000): rc 0 00000020:00000080:1.0:1789445912.617174:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afe9fa2a000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789445912.618306:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afea4d2f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789445912.618325:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe9fa2a000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789445912.619184:0:12956:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789445912.619193:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789445912.619199:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789445912.619208:0:12956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789445912.619467:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789445912.619476:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1789445912.619593:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afe8533d000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789445912.619606:0:36:0:(genops.c:885:class_export_put()) final put ffff9afe9ee6b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789445912.619610:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe9ee6b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789445912.619616:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789445912.619960:0:12956:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afe9d560800 1 00000020:00000080:0.0:1789445912.619968:0:12956:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255d8f 00000020:00000080:0.0:1789445912.619977:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afe87db5800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789445912.619994:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789445912.620000:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789445912.620006:0:12956:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789445912.620011:0:12956:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9afe85c38000) has no exports 00000020:00000080:3.0:1789445912.620191:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe87db5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789445912.699268:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789445912.699287:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789445912.699295:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afe9d565000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789445912.699301:0:12956:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe9d565000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789445912.699312:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789445912.699479:0:12956:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9afe9d560000 00000020:01000000:0.0:1789445912.699533:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789445912.699539:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789445912.699546:0:12956:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789445912.699551:0:12956:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9afea4f90000) has no exports 00000100:00100000:0.0:1789445912.700199:0:5842:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9afea4f3fe00:5842] 2 exiting: rc = 0 00000100:00100000:2.0:1789445912.701107:0:8204:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9afebff8c200:8204] 3 exiting: rc = 0 00000100:00100000:0.0:1789445912.701214:0:5840:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9afe919b7e00:5840] 0 exiting: rc = 1 00000100:00100000:0.0:1789445912.701307:0:5841:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9afea4f3fc00:5841] 1 exiting: rc = 0 00000100:00100000:0.0:1789445912.701397:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701411:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701423:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701436:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701443:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701463:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701471:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701478:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701494:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701500:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701507:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701528:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701534:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701540:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701551:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701558:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701564:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701578:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701586:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701592:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701598:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701604:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701611:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701617:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701692:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701702:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701708:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701714:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701720:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701726:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701732:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701738:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701745:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701751:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701759:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701766:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701774:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701781:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701788:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701795:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701802:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701809:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701816:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701821:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701827:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701833:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701847:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701853:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701858:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.701994:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.702003:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.702010:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.702021:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.702029:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.702035:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.702187:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.702196:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.702202:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.702208:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.702215:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.702221:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.702227:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.702243:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.702261:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.717737:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9afea4f3f400:5843] 0 exiting: rc = 1 00000100:00100000:2.0:1789445912.719633:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9afea4d7da00:5844] 1 exiting: rc = 0 00000100:00100000:0.0:1789445912.719752:0:11955:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9afeba62f600:11955] 2 exiting: rc = 0 00000100:00100000:3.0:1789445912.720004:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720015:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720023:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720030:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720166:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720178:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720186:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720193:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720199:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720204:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720211:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720219:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720253:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720259:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720265:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720271:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720276:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720282:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720287:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720293:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720298:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720304:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720310:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720316:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720322:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720327:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720333:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720338:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720344:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720348:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720353:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720359:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720366:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720376:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720436:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720444:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720449:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720456:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720462:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720468:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720474:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720479:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720565:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720699:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720710:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720715:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720721:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720736:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720741:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720746:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720752:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720758:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720765:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720772:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720778:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720785:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720790:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720796:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720802:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720807:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720813:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720819:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720825:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.720831:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.725183:0:12062:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff9afeb56f9600:12062] 2 exiting: rc = 0 00000100:00100000:0.0:1789445912.725456:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9afe85dfb200:5846] 1 exiting: rc = 0 00000100:00100000:1.0:1789445912.730441:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9afea480c600:5845] 0 exiting: rc = 1 00000100:00100000:3.0:1789445912.730903:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.730915:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.730923:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.730931:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.730938:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.730945:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.730952:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.730962:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.730970:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.730977:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.730984:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731004:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731015:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731020:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731027:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731033:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731072:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731095:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731101:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731108:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731115:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731122:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731129:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731154:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731162:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731168:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731177:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731183:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731189:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731195:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731202:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731210:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731217:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731225:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731243:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731266:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731274:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731281:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731289:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731296:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731305:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731311:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731318:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731325:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731331:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731339:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731346:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731367:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731375:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731382:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731389:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731397:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731413:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731420:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731428:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731435:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731441:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731446:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731453:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731472:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731479:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731486:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731492:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.731499:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.759028:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9afea480c200:5847] 0 exiting: rc = 1 00000100:00100000:1.0:1789445912.759419:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9afea4830200:5848] 1 exiting: rc = 0 00000100:00100000:3.0:1789445912.759570:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760775:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760782:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760792:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760800:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760809:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760815:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760822:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760827:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760834:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760841:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760848:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760856:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760863:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760870:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760878:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760885:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760892:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760899:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760905:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760911:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760918:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760925:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760953:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760961:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760969:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760976:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760983:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760990:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.760996:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761004:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761011:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761018:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761026:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761034:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761061:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761073:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761085:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761097:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761102:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761108:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761113:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761119:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761130:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761138:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761143:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761149:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761155:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761161:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761168:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761174:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761185:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761192:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761199:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761205:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761211:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761216:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761222:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761247:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761253:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761258:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761264:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761270:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.761277:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.769648:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9afea4831400:5849] 0 exiting: rc = 1 00000100:00100000:0.0:1789445912.769733:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9afe8576d800:5850] 1 exiting: rc = 0 00000100:00100000:3.0:1789445912.769805:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.769814:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.769820:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.769826:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.769833:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.769840:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.769845:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.769850:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.769856:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.769862:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770028:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770036:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770591:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770599:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770605:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770611:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770617:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770633:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770705:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770714:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770720:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770726:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770732:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770737:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770742:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770748:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770753:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770758:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770764:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770789:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770794:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770800:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770805:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770810:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770818:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770824:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770831:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770836:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770841:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770846:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770851:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770856:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.770862:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771029:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771063:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771072:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771078:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771084:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771090:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771096:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771102:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771107:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771114:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771119:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771125:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771131:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771137:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771143:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771149:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771154:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771160:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771165:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771170:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.771176:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789445912.772299:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9afec1844000:5851] 0 exiting: rc = 1 00000100:00100000:1.0:1789445912.772547:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9afec1847000:5852] 1 exiting: rc = 0 00000100:00100000:3.0:1789445912.772631:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772745:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772756:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772765:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772772:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772781:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772788:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772795:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772802:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772811:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772819:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772826:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772833:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772840:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772847:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772855:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772861:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772878:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772886:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772893:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772899:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772905:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772910:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772917:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772923:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772929:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772937:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772946:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772954:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772961:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772968:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772975:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772983:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772990:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.772998:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773022:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773033:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773173:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773184:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773190:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773197:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773208:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773216:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773222:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773228:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773244:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773250:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773256:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773262:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773267:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773273:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773279:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773283:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773289:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773295:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773301:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773307:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773313:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773319:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773324:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773330:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773338:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773344:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.773350:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445912.774544:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9afec1847600:5854] 1 exiting: rc = 0 00000100:00100000:0.0:1789445912.774842:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9afec1845000:5853] 0 exiting: rc = 1 00000100:00100000:3.0:1789445912.775283:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9afec18f4200:5855] 2 exiting: rc = 0 00000100:00100000:3.0:1789445912.775359:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775367:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775374:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775383:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775389:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775409:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775415:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775421:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775427:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775434:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775440:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775447:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775462:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775470:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775477:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775809:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775817:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775823:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775829:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775836:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775842:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775848:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775854:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775860:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775879:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775887:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775894:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775900:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775907:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775913:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775918:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775924:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775931:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775938:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775946:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775954:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775976:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775984:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775991:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.775998:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776015:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776022:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776029:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776035:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776200:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776205:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776211:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776217:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776224:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776230:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776248:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776255:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776264:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776270:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776276:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776282:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776287:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776293:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776299:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776304:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776311:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776318:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776326:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445912.776332:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789445912.789594:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789445912.789612:0:12956:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789445912.789620:0:12956:0:(genops.c:885:class_export_put()) final put ffff9afead8c7800/MDS_uuid 00000020:00000080:0.0:1789445912.789637:0:12956:0:(genops.c:844:class_export_destroy()) destroying export ffff9afead8c7800/MDS_uuid for MDS 00000020:01000000:0.0:1789445912.789656:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789445912.789856:0:12956:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789445913.307570:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445914.330981:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445914.714456:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369742056448:0@lo:400:kworker.0 00000100:00100000:1.0:1789445914.714592:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369742056320:0@lo:400:kworker.0 00000400:00000100:1.0:1789445914.714658:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876369742056320 offset 0 length 224: 4 00000100:00100000:1.0:1789445914.714757:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789445914.714764:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742056192:0@lo:400:kworker.0 00000400:00000100:1.0:1789445914.714789:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876369742056192 offset 0 length 224: 4 00000400:00000100:2.0:1789445914.716237:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876369742056448 offset 0 length 224: 4 00010000:00010000:3.0:1789445915.369548:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789445915.801088:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789445915.801101:0:6708:0:(genops.c:885:class_export_put()) final put ffff9afeb536b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789445915.801139:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afeb536b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789445915.801197:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afeb5369000 for lustre-OST0000 00000001:00100000:0.0:1789445915.812715:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789445915.812727:0:7638:0:(genops.c:885:class_export_put()) final put ffff9afebfa4f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789445915.812821:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afebfa4f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789445915.812879:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afebfa4a800 for lustre-OST0001 00000020:01000004:3.0:1789445916.159994:0:13109:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789445916.182277:0:13109:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789445916.182350:0:13109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445916.182370:0:13109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472560d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445916.182401:0:13109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d472560d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445916.182410:0:13109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d472560d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445916.182445:0:13109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789445916.182453:0:13109:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789445916.182485:0:13109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789445916.182503:0:13109:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afeadb98e00 x1876369742056320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445930 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445916.182528:0:13109:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789445916.182537:0:13109:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789445916.182585:0:13109:0:(import.c:65:import_set_state_nolock()) ffff9afebfa4e800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789445916.182662:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445916.182671:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d472560d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445916.182680:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989a00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1789445916.182684:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d472560d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445916.182694:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1b37c4d472560d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789445916.182702:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1b37c4d472560d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445916.182709:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789445916.182711:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789445916.182714:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789445916.182746:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d472560d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445916.182753:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789445916.182756:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369742056320:0@lo:400:kworker.0 00010000:00010000:0.0:1789445916.182782:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d472560d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445916.182789:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe8e989a00/0xc1b37c4d472560d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1b37c4d472560d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445916.182804:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445916.182806:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445916.182808:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1789445916.182808:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789445916.182824:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369742056704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789445916.182824:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876369742056576:0@lo:39:umount.0 00000100:00100000:2.0:1789445916.184214:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445916.185133:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742056704 00000100:00100000:3.0:1789445916.185150:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742056704 00000100:00100000:3.0:1789445916.185225:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789445916.185236:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81214a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3310:x1876369742056704:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789445916.185245:0:5826:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789445916 with bad export cookie 13957636341499256249 00000400:00000100:0.0:1789445916.186833:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876369742056576 offset 0 length 224: 4 00000100:00100000:3.0:1789445916.198685:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81214a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3310:x1876369742056704:12345-0@lo:103:ldlm_bl.0 Request processed in 13430us (14464us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789445916.198711:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789445916.198859:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.159@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789445916.198869:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9afead8c0000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789445916.198873:0:3310:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1789445916.205802:0:3310:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.159@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789445916.205811:0:3310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789445916.205827:0:3310:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afeadb9a680 x1876369742056192/t0(0) o400->MGC192.168.206.159@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789445930 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445916.205932:0:3310:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afeba5cdc00 x1876369742056704/t0(0) o103->MGC192.168.206.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789445932 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789445916.205946:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789445916.205950:0:3310:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789445916.205978:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789445916.205984:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9afead8c0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789445916.205992:0:3310:0:(import.c:545:import_select_connection()) MGC192.168.206.159@tcp: connect to NID 0@lo last attempt 131 00000100:00080000:2.0:1789445916.206015:0:3310:0:(import.c:666:import_select_connection()) MGC192.168.206.159@tcp: import ffff9afead8c0000 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:3.0:1789445916.206307:0:3310:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afeadb9a300 x1876369742056832/t0(0) o250->MGC192.168.206.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789445916.206351:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3310:1876369742056704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789445916.206439:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3309:1876369742056832:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1789445916.206522:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876369742056832 offset 0 length 520: 4 00000100:00100000:1.0:1789445916.206705:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3313:1876369742056192:0@lo:400:kworker.0 00010000:00010000:0.0:1789445916.379328:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445917.404583:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445918.426512:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445919.450612:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789445919.836869:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a74a4946-2de5-4f94-9e7c-96ec5d765e2c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789445919.836891:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) a74a4946-2de5-4f94-9e7c-96ec5d765e2c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789445919.837159:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789445919.837189:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742056960:0@lo:400:kworker.0 00000400:00000100:1.0:1789445919.837281:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876369742056960 offset 0 length 224: 4 00010000:00010000:3.0:1789445920.474950:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445921.500156:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789445921.882217:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a74a4946-2de5-4f94-9e7c-96ec5d765e2c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789445921.882233:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) a74a4946-2de5-4f94-9e7c-96ec5d765e2c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789445921.882345:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789445921.882375:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742057088:0@lo:400:kworker.0 00000400:00000100:0.0:1789445921.882449:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876369742057088 offset 0 length 224: 4 00010000:00010000:3.0:1789445922.527539:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445923.546331:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445924.570742:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445925.595466:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445926.490802:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789445916/real 1789445916] req@ffff9afeadb9a300 x1876369742056832/t0(0) o250->MGC192.168.206.159@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789445926 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445926.490870:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afeadb9a300 x1876369742056832/t0(0) o250->MGC192.168.206.159@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789445926 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445926.490886:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789445916/real 1789445916] req@ffff9afeadb98a80 x1876369742056576/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789445926 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445926.490902:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afeadb98a80 x1876369742056576/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789445926 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789445926.490936:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afead8c0000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789445926.491076:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789445926.491084:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3309:1876369742056832:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1789445926.491096:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afebfa4e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789445926.491145:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876369742056576:0@lo:39:umount.0 00000100:00080000:1.0:1789445926.493396:0:13109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789445926.493406:0:13109:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789445926.493414:0:13109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789445926.494508:0:13109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472560de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445926.494533:0:13109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472560de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472560e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445926.494542:0:13109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472560de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d472560e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445926.494550:0:13109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472560de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d472560e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445926.494582:0:13109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789445926.494591:0:13109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d47256307 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725630e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445926.494622:0:13109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d47256307 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d4725630e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445926.494629:0:13109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d47256307 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d4725630e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445926.494635:0:13109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d47256307 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d4725630e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445926.494658:0:13109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789445926.494663:0:13109:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789445926.494688:0:13109:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789445926.494693:0:13109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:2.0:1789445926.495195:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789445926.495205:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472560de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d472560e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445926.495214:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf200 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1789445926.495219:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472560de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d472560e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445926.495233:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472560de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1b37c4d472560e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789445926.495245:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472560de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1b37c4d472560e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445926.495254:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789445926.495258:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1789445926.495261:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1789445926.495284:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9afead8c0000 00010000:00010000:2.0:1789445926.495291:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472560de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1b37c4d472560e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445926.495318:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472560de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1b37c4d472560e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445926.495336:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445926.495340:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d47256307 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d4725630e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445926.495346:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bfe00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1789445926.495348:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d47256307 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d4725630e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445926.495355:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d47256307 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1b37c4d4725630e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789445926.495360:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d47256307 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1b37c4d4725630e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445926.495365:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789445926.495367:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789445926.495369:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789445926.495374:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9afead8c0000 00010000:00010000:2.0:1789445926.495377:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d47256307 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1b37c4d4725630e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445926.495384:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d47256307 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1b37c4d4725630e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445926.495397:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445926.495399:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445926.495409:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445926.495814:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789445926.495938:0:13109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789445926.495954:0:13109:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789445926.495961:0:13109:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9afeb5c83380) has no exports 00000020:00080000:1.0:1789445926.496010:0:13109:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9afeb5c83380) has no exports 00000100:00080000:3.0:1789445926.497344:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a74a4946-2de5-4f94-9e7c-96ec5d765e2c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789445926.497355:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789445926.497361:0:38:0:(import.c:65:import_set_state_nolock()) ffff9afead8c0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789445926.497373:0:38:0:(import.c:545:import_select_connection()) MGC192.168.206.159@tcp: connect to NID 0@lo last attempt 354 00000100:00080000:3.0:1789445926.497381:0:38:0:(import.c:630:import_select_connection()) MGC192.168.206.159@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789445926.497406:0:38:0:(import.c:666:import_select_connection()) MGC192.168.206.159@tcp: import ffff9afead8c0000 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:3.0:1789445926.497460:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afeadb99880 x1876369742057216/t0(0) o250->MGC192.168.206.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789445926.497564:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789445926.497582:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742057344:0@lo:400:kworker.0 00000400:00000100:3.0:1789445926.497645:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876369742057344 offset 0 length 224: 4 00000100:00100000:0.0:1789445926.498162:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3309:1876369742057216:0@lo:250:kworker.0 00000400:00000100:0.0:1789445926.498207:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876369742057216 offset 0 length 520: 4 00000020:01000000:1.0:1789445926.508247:0:13109:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afeb57773c0 - data ffff9afeae284798/ffff9afeb5b01000 00000020:01000000:1.0:1789445926.508432:0:13109:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afe87d45840 - data ffff9afeae01ca20/ffff9afebf6ed400 00100000:10000000:0.0:1789445926.526691:0:13109:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789445926.568605:0:13109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255eed 00000020:00000080:2.0:1789445926.568619:0:13109:0:(genops.c:885:class_export_put()) final put ffff9afe8997c000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789445926.568643:0:13109:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afe8533d800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789445926.568648:0:13109:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afe8533d800 2 00000020:01000004:2.0:1789445926.568652:0:13109:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9afe8533d800 from lustre-OST0000 00000020:00000080:2.0:1789445926.568684:0:13109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789445926.568695:0:13109:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789445926.568699:0:13109:0:(genops.c:885:class_export_put()) final put ffff9afe9ee51800/lustre-OST0000_UUID 00000020:00000080:2.0:1789445926.568702:0:13109:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe9ee51800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789445926.568711:0:13109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789445926.568766:0:13109:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789445926.568771:0:13109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789445926.568776:0:13109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789445926.568781:0:13109:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789445926.568789:0:13109:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9afebfa31800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789445926.568796:0:13109:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9afe85c3cd40) has exports, disconnecting them 00000020:00080000:2.0:1789445926.568802:0:13109:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9afebfa31800), last request at 1789445710 00000020:00000080:2.0:1789445926.568807:0:13109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255f17 00000020:00080000:2.0:1789445926.568817:0:13109:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afebfa31800): rc 0 00000020:00000080:2.0:1789445926.568823:0:13109:0:(genops.c:885:class_export_put()) final put ffff9afebfa31800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789445926.569146:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe8997c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789445926.569161:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9afebfa31800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789445926.577486:0:13109:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789445926.577499:0:13109:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789445926.577505:0:13109:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789445926.577514:0:13109:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789445926.577738:0:13109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789445926.577750:0:13109:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789445926.577758:0:13109:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afe8533d800 1 00000020:00000080:0.0:1789445926.577766:0:13109:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255ea7 00000020:00000080:0.0:1789445926.577777:0:13109:0:(genops.c:885:class_export_put()) final put ffff9afe8533a000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789445926.577783:0:13109:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789445926.577789:0:13109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789445926.577794:0:13109:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789445926.577798:0:13109:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9afea4f919c0) has no exports 00000020:00000080:1.0:1789445926.578273:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afebfa4e800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789445926.578282:0:38:0:(genops.c:885:class_export_put()) final put ffff9afebb4dc000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789445926.578286:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9afebb4dc000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789445926.578297:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789445926.578362:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe8533a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789445926.626777:0:13109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789445926.626803:0:13109:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789445926.626813:0:13109:0:(genops.c:885:class_export_put()) final put ffff9afe892ec800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789445926.626821:0:13109:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe892ec800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789445926.626855:0:13109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789445926.627002:0:13109:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9afe8533e000 00000020:02000400:1.0:1789445926.627083:0:13109:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789445926.714287:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445927.771150:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445928.800803:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789445929.437830:0:13261:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789445929.450874:0:13261:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789445929.450979:0:13261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d472560b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445929.450999:0:13261:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d472560b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472560bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445929.451007:0:13261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d472560b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d472560bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445929.451035:0:13261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d472560b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d472560bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445929.451186:0:13261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789445929.451194:0:13261:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789445929.451229:0:13261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789445929.451243:0:13261:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afeadb9ad80 x1876369742056448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445930 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445929.451263:0:13261:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afd81217100 x1876369742056960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445935 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445929.451277:0:13261:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afd81215500 x1876369742057088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445937 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445929.451290:0:13261:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afeadb9bb80 x1876369742057344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445942 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445929.451300:0:13261:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789445929.451307:0:13261:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789445929.451341:0:13261:0:(import.c:65:import_set_state_nolock()) ffff9afeba784000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789445929.451507:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445929.451515:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d472560b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d472560bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445929.451524:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe81678200 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1789445929.451528:0:8445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d472560b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d472560bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445929.451538:0:8445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d472560b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1b37c4d472560bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789445929.451553:0:8445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d472560b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1b37c4d472560bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445929.451559:0:8445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789445929.451562:0:8445:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789445929.451565:0:8445:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789445929.451578:0:8445:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9afead8c0000 00010000:00010000:0.0:1789445929.451583:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d472560b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1b37c4d472560bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445929.451590:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe81678200/0xc1b37c4d472560b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1b37c4d472560bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445929.451603:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445929.451605:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445929.451606:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445929.451641:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742057088:0@lo:400:kworker.0 00000100:00100000:0.0:1789445929.451684:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876369742057344:0@lo:400:kworker.0 00000100:00100000:0.0:1789445929.451710:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876369742057472:0@lo:39:umount.0 00000400:00000100:0.0:1789445929.451765:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876369742057472 offset 0 length 224: 4 00000100:00100000:0.0:1789445929.452407:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369742056448:0@lo:400:kworker.0 00000100:00100000:0.0:1789445929.452444:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742056960:0@lo:400:kworker.0 00010000:00010000:2.0:1789445929.819014:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445930.842300:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789445931.610263:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a74a4946-2de5-4f94-9e7c-96ec5d765e2c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789445931.610276:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) a74a4946-2de5-4f94-9e7c-96ec5d765e2c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789445931.866487:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445932.890241:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445933.914740:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445934.938973:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445935.962245:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789445936.731742:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a74a4946-2de5-4f94-9e7c-96ec5d765e2c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789445936.731755:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a74a4946-2de5-4f94-9e7c-96ec5d765e2c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789445936.986630:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445938.010557:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445939.034339:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445939.674239:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789445929/real 1789445929] req@ffff9afd81214380 x1876369742057472/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789445939 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445939.674282:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afd81214380 x1876369742057472/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789445939 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789445939.674306:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afeba784000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789445939.674334:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876369742057472:0@lo:39:umount.0 00000100:00080000:2.0:1789445939.674559:0:13261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789445939.674565:0:13261:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789445939.674570:0:13261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789445939.676617:0:13261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bea00/0xc1b37c4d472560c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472560c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445939.676666:0:13261:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bea00/0xc1b37c4d472560c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472560c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445939.676674:0:13261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bea00/0xc1b37c4d472560c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d472560c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445939.676682:0:13261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.159@tcp lock: ffff9afeb57bea00/0xc1b37c4d472560c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d472560c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445939.676722:0:13261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789445939.676731:0:13261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afea4906200/0xc1b37c4d472562f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47256300 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445939.676738:0:13261:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afea4906200/0xc1b37c4d472562f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47256300 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445939.676744:0:13261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afea4906200/0xc1b37c4d472562f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d47256300 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445939.676751:0:13261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.159@tcp lock: ffff9afea4906200/0xc1b37c4d472562f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1b37c4d47256300 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445939.676775:0:13261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789445939.676780:0:13261:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789445939.676806:0:13261:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789445939.676811:0:13261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789445939.676818:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789445939.676824:0:13261:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789445939.676830:0:13261:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9afeba50cd40) has no exports 00000020:00080000:2.0:1789445939.676865:0:13261:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9afeba50cd40) has no exports 00010000:00010000:3.0:1789445939.676982:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789445939.676997:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afeb57bea00/0xc1b37c4d472560c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d472560c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445939.677010:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bea00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:3.0:1789445939.677014:0:8445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57bea00/0xc1b37c4d472560c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d472560c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445939.677025:0:8445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afeb57bea00/0xc1b37c4d472560c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1b37c4d472560c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789445939.677095:0:8445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57bea00/0xc1b37c4d472560c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1b37c4d472560c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789445939.677111:0:8445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789445939.677115:0:8445:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789445939.677118:0:8445:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789445939.677139:0:8445:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9afead8c0000 00010000:00010000:3.0:1789445939.677143:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afeb57bea00/0xc1b37c4d472560c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1b37c4d472560c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445939.677151:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afeb57bea00/0xc1b37c4d472560c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1b37c4d472560c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445939.677170:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789445939.677174:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afea4906200/0xc1b37c4d472562f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d47256300 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445939.677180:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906200 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:3.0:1789445939.677183:0:8445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afea4906200/0xc1b37c4d472562f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1b37c4d47256300 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445939.677190:0:8445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afea4906200/0xc1b37c4d472562f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1b37c4d47256300 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789445939.677196:0:8445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afea4906200/0xc1b37c4d472562f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1b37c4d47256300 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789445939.677202:0:8445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789445939.677204:0:8445:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789445939.677210:0:8445:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789445939.677218:0:8445:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9afead8c0000 00010000:00010000:3.0:1789445939.677221:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afea4906200/0xc1b37c4d472562f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1b37c4d47256300 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445939.677228:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afea4906200/0xc1b37c4d472562f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1b37c4d47256300 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445939.677243:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445939.677245:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445939.677247:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445939.680935:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789445939.687449:0:13261:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afeb5777360 - data ffff9afeae348000/ffff9afeb5b00000 00000020:01000000:0.0:1789445939.691798:0:13261:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afea4c1e4e0 - data ffff9afeae3f4e58/ffff9afeb54f5000 00100000:10000000:0.0:1789445939.709747:0:13261:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789445939.732351:0:13261:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255fb8 00000020:00000080:2.0:1789445939.732361:0:13261:0:(genops.c:885:class_export_put()) final put ffff9afe9f986800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789445939.732387:0:13261:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afebb4dd000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789445939.732391:0:13261:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afebb4dd000 2 00000020:01000004:2.0:1789445939.732394:0:13261:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9afebb4dd000 from lustre-OST0001 00000020:00000080:2.0:1789445939.732415:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789445939.732424:0:13261:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789445939.732426:0:13261:0:(genops.c:885:class_export_put()) final put ffff9afe9f983800/lustre-OST0001_UUID 00000020:00000080:2.0:1789445939.732429:0:13261:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe9f983800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789445939.732435:0:13261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789445939.732556:0:13261:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a74a4946-2de5-4f94-9e7c-96ec5d765e2c->MGS 00010000:00010000:2.0:1789445939.732572:0:13261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe8e989800/0xc1b37c4d47255eca lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1b37c4d47255ed1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789445939.732584:0:13261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e989800/0xc1b37c4d47255eca lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1b37c4d47255ed1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445939.732591:0:13261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789445939.732593:0:13261:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789445939.732597:0:13261:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789445939.732609:0:13261:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9afead8c0000 00010000:00010000:2.0:1789445939.732613:0:13261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe8e989800/0xc1b37c4d47255eca lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1b37c4d47255ed1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445939.732627:0:13261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47256108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1b37c4d4725610f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789445939.732634:0:13261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47256108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1b37c4d4725610f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445939.732654:0:13261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789445939.732657:0:13261:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789445939.732658:0:13261:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789445939.732668:0:13261:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9afead8c0000 00010000:00010000:2.0:1789445939.732671:0:13261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47256108 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1b37c4d4725610f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789445939.732686:0:13261:0:(import.c:65:import_set_state_nolock()) ffff9afead8c0000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789445939.732690:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789445939.732692:0:13261:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789445939.732693:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789445939.732697:0:13261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789445939.732707:0:13261:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afeadb99880 x1876369742057216/t0(0) o250->MGC192.168.206.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789445941 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:1.0:1789445939.732804:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9afe9f986800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:2.0:1789445939.732839:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789445939.732842:0:13261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:3.0:1789445939.733373:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a74a4946-2de5-4f94-9e7c-96ec5d765e2c:3309:1876369742057216:0@lo:250:kworker.0 10000000:01000000:2.0:1789445939.733434:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789445939.733441:0:13261:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255dab 00000020:00000080:2.0:1789445939.733446:0:13261:0:(genops.c:885:class_export_put()) final put ffff9afead8c2000/a74a4946-2de5-4f94-9e7c-96ec5d765e2c 00000020:01000000:2.0:1789445939.733459:0:13261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.159@tcp (flags='') 00000020:00000080:2.0:1789445939.733464:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789445939.733469:0:13261:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.159@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789445939.733473:0:13261:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9afea4f94d40) has no exports 10000000:01000000:3.0:1789445939.733520:0:5838:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789445939.733590:0:13261:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.159@tcp: client import never connected 00000100:00080000:2.0:1789445939.733593:0:13261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789445939.733595:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789445939.733597:0:13261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789445939.733599:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789445939.733631:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789445939.733635:0:13261:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.159@tcp (uuid a74a4946-2de5-4f94-9e7c-96ec5d765e2c) 00000020:01000000:2.0:1789445939.733639:0:13261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789445939.733648:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789445939.733651:0:13261:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789445939.733656:0:13261:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9afeba7a3000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789445939.733661:0:13261:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9afe9f924d40) has exports, disconnecting them 00000020:00080000:2.0:1789445939.733665:0:13261:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9afeba7a3000), last request at 1789445729 00000020:00000080:2.0:1789445939.733669:0:13261:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255fe2 00000020:00080000:2.0:1789445939.733677:0:13261:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afeba7a3000): rc 0 00000020:00000080:2.0:1789445939.733681:0:13261:0:(genops.c:885:class_export_put()) final put ffff9afeba7a3000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789445939.734554:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9afead8c2000/a74a4946-2de5-4f94-9e7c-96ec5d765e2c for MGC192.168.206.159@tcp 00000020:00000080:1.0:1789445939.734564:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afead8c0000 for MGC192.168.206.159@tcp 00000020:00000080:1.0:1789445939.734570:0:38:0:(genops.c:885:class_export_put()) final put ffff9afead8c6800/a74a4946-2de5-4f94-9e7c-96ec5d765e2c 00000020:00000080:1.0:1789445939.734573:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9afead8c6800/a74a4946-2de5-4f94-9e7c-96ec5d765e2c for MGC192.168.206.159@tcp 00000020:01000000:1.0:1789445939.734576:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.159@tcp (a74a4946-2de5-4f94-9e7c-96ec5d765e2c) 00000020:00000080:1.0:1789445939.734795:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9afeba7a3000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789445939.735258:0:13261:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789445939.735262:0:13261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789445939.735266:0:13261:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789445939.735270:0:13261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789445939.735345:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9afeba784000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1789445939.735430:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789445939.735618:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789445939.735733:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1789445939.736456:0:5825:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9afea4e52600:5825] 1 exiting: rc = 0 00000100:00100000:3.0:1789445939.736515:0:7626:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9afe9d607400:7626] 2 exiting: rc = 0 00000100:00100000:1.0:1789445939.736596:0:5824:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9afea4e53200:5824] 0 exiting: rc = 1 00000100:00100000:3.0:1789445939.737904:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445939.738495:0:5826:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9afea4e53a00:5826] 0 exiting: rc = 1 00000100:00100000:1.0:1789445939.738626:0:5828:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9afe893ee000:5828] 2 exiting: rc = 0 00000100:00100000:3.0:1789445939.741158:0:5827:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9afea4ee0a00:5827] 1 exiting: rc = 0 00000100:00100000:3.0:1789445939.742896:0:7627:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9afeba1c2200:7627] 3 exiting: rc = 0 00000100:00100000:1.0:1789445939.751251:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751262:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751269:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751275:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751281:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751287:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751292:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751298:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751305:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751310:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751315:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751321:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751328:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751333:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751338:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751361:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751366:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751371:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751376:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751381:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751385:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751390:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751395:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751400:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751405:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751410:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751415:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751420:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751425:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751430:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751435:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751441:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751445:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751451:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751457:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751462:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751468:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751473:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751478:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751483:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751488:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751493:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751497:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751502:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751507:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751512:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751518:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751523:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751528:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751534:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751545:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751550:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751555:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751561:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751566:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751574:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751581:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751587:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751593:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751598:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751603:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751607:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751613:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.751618:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789445939.755888:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789445939.755899:0:13261:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789445939.755905:0:13261:0:(genops.c:885:class_export_put()) final put ffff9afeba782000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789445939.755918:0:13261:0:(genops.c:844:class_export_destroy()) destroying export ffff9afeba782000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789445939.755924:0:13261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1789445939.755965:0:13261:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afebb4dd000 1 00000020:00000080:1.0:1789445939.755970:0:13261:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc1b37c4d47255f87 00000020:00000080:1.0:1789445939.755975:0:13261:0:(genops.c:885:class_export_put()) final put ffff9afebb4d8800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789445939.755986:0:13261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789445939.755998:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9afebb4d8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789445939.756009:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789445939.756014:0:13261:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789445939.756017:0:13261:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9afeb57c0000) has no exports 00000020:00000080:1.0:1789445939.777257:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789445939.777273:0:13261:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789445939.777279:0:13261:0:(genops.c:885:class_export_put()) final put ffff9afebb4d9800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789445939.777283:0:13261:0:(genops.c:844:class_export_destroy()) destroying export ffff9afebb4d9800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789445939.777291:0:13261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789445939.777483:0:13261:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9afebb4db000 00000020:01000000:1.0:1789445939.777512:0:13261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789445939.777516:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789445939.777520:0:13261:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789445939.777524:0:13261:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9afe85c3b380) has no exports 00000020:00000080:1.0:1789445939.777548:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789445939.777554:0:13261:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789445939.777557:0:13261:0:(genops.c:885:class_export_put()) final put ffff9afeb4f98000/OSS_uuid 00000020:00000080:1.0:1789445939.777559:0:13261:0:(genops.c:844:class_export_destroy()) destroying export ffff9afeb4f98000/OSS_uuid for OSS 00000020:01000000:1.0:1789445939.777564:0:13261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1789445939.777589:0:5837:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789445939.777729:0:6684:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9afeb9f0f600:6684] 1 exiting: rc = 0 00000100:00100000:1.0:1789445939.777779:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9afe96456200:6685] 2 exiting: rc = 0 00000100:00100000:1.0:1789445939.777825:0:11692:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9afeb4bdf400:11692] 3 exiting: rc = 0 00000100:00100000:2.0:1789445939.778662:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9afeb9e3e800:6682] 0 exiting: rc = 1 00000100:00100000:1.0:1789445939.778824:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778833:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778840:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778846:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778851:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778856:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778861:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778866:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778881:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778887:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778893:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778897:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778902:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778907:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778920:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778926:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778932:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778937:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778943:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778948:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778953:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778958:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778970:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778976:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778981:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778986:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778991:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.778995:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779000:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779005:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779009:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779014:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779019:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779025:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779029:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779034:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779039:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779060:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779066:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779071:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779075:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779080:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779085:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779089:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779095:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779100:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779116:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779426:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779435:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779440:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779445:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779450:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779456:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779461:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779465:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779469:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779475:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779488:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779492:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779497:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779502:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779507:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779512:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.779518:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.781134:0:6686:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9afe8a164600:6686] 0 exiting: rc = 1 00000100:00100000:0.0:1789445939.782600:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9afea480d000:6687] 1 exiting: rc = 0 00000100:00100000:1.0:1789445939.782770:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782779:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782784:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782790:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782796:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782801:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782806:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782812:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782817:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782822:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782828:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782833:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782837:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782843:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782848:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782853:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782858:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782864:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782869:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782875:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782880:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782885:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782891:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782896:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782901:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782907:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782979:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.782997:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783002:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783007:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783013:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783018:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783023:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783028:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783033:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783040:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783067:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783077:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783086:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783096:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783113:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783119:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783123:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783128:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783133:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783138:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783144:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783149:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783154:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783160:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783164:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783169:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783174:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783179:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783185:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783190:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783195:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783200:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783206:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783210:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783216:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783220:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783233:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.783239:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.785014:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9afe9d606000:6688] 0 exiting: rc = 1 00000100:00100000:1.0:1789445939.785509:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9afe91b1c000:6690] 2 exiting: rc = 0 00000100:00100000:0.0:1789445939.785662:0:6689:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9afe9d607200:6689] 1 exiting: rc = 0 00000100:00100000:1.0:1789445939.785817:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.785825:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.785832:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.785851:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.785858:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.785864:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.785870:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.785876:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.785881:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.785887:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.785893:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.785900:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.785905:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.785992:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.785999:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786005:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786011:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786016:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786022:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786028:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786034:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786039:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786154:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786162:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786168:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786173:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786179:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786199:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786205:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786211:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786217:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786233:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786239:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786245:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786251:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786257:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786263:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786269:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786275:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786281:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786287:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786292:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786298:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786303:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786309:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786314:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786320:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786327:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786332:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786338:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786345:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786364:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786372:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786378:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786384:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786390:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786396:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786402:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786409:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786425:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786432:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786439:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786445:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.786451:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.795960:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9afe85111800:6692] 1 exiting: rc = 0 00000100:00100000:3.0:1789445939.796242:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9afeadb94400:6691] 0 exiting: rc = 1 00000100:00100000:1.0:1789445939.796329:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796346:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796352:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796358:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796364:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796369:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796374:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796380:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796385:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796390:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796396:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796401:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796406:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796411:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796416:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796421:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796426:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796451:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796460:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796465:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796470:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796475:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796480:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796489:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796494:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796499:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796504:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796510:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796515:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796520:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796526:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796531:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796537:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796542:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796548:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796553:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796573:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796579:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796584:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796589:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796595:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796599:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796605:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796611:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796616:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796622:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796627:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796633:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796637:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796643:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796647:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796652:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796658:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796663:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796669:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796681:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796690:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796696:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796706:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796711:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796717:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796722:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796732:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.796738:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789445939.797804:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9afebb42a400:6693] 0 exiting: rc = 1 00000100:00100000:3.0:1789445939.797989:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9afebb42a800:6694] 1 exiting: rc = 0 00000100:00100000:1.0:1789445939.798230:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798237:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798244:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798250:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798255:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798260:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798266:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798279:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798293:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798298:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798304:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798309:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798314:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798319:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798323:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798329:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798334:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798339:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798344:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798349:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798365:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798371:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798376:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798381:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798386:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798391:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798396:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798401:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798406:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798411:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798417:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798422:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798437:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798443:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798448:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798455:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798461:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798467:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798473:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798478:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798483:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798488:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798500:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798506:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798525:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798532:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798538:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798544:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798550:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798554:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798559:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798564:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798570:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798575:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798580:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798585:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798601:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798607:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798612:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798617:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798622:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798627:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798633:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789445939.798637:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789445939.809371:0:13261:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789445954.588845:0:13878:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg659-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789445961.704725:0:14339:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789445961.704730:0:14339:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789445961.704830:0:14339:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9afeada0c800 00000020:01000004:0.0:1789445961.704844:0:14339:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789445961.704851:0:14339:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789445961.704864:0:14339:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9afe9f920000) 00000020:00000080:0.0:1789445961.704876:0:14339:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789445961.716757:0:14339:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789445961.718766:0:14339:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1789445961.719228:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 417: rc = 0 00100000:10000000:0.0:1789445961.719325:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 417: rc = 0 00100000:10000000:0.0:1789445961.719522:0:14339:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789445961.719587:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 417: rc = 0 00100000:10000000:0.0:1789445961.719723:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 417: rc = 0 00100000:10000000:0.0:1789445961.719822:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 417: rc = 0 00100000:10000000:0.0:1789445961.719922:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 417: rc = 0 00100000:10000000:0.0:1789445961.720225:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 419: rc = 0 00100000:10000000:0.0:1789445961.721346:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 309: rc = 0 00100000:10000000:0.0:1789445961.721446:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 309: rc = 0 00100000:10000000:0.0:1789445961.721892:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 313: rc = 0 00100000:10000000:0.0:1789445961.722471:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 313: rc = 0 00100000:10000000:0.0:1789445961.722730:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 313: rc = 0 00100000:10000000:0.0:1789445961.723161:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 313: rc = 0 00100000:10000000:0.0:1789445961.723422:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 313: rc = 0 00100000:10000000:0.0:1789445961.723664:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 313: rc = 0 00100000:10000000:0.0:1789445961.724027:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 313: rc = 0 00100000:10000000:0.0:1789445961.724354:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 313: rc = 0 00100000:10000000:0.0:1789445961.724593:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 313: rc = 0 00100000:10000000:0.0:1789445961.724940:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 313: rc = 0 00100000:10000000:0.0:1789445961.725309:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 313: rc = 0 00100000:10000000:0.0:1789445961.725554:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 313: rc = 0 00100000:10000000:0.0:1789445961.726194:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 465: rc = 0 00100000:10000000:0.0:1789445961.726450:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 465: rc = 0 00100000:10000000:0.0:1789445961.726687:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 465: rc = 0 00100000:10000000:0.0:1789445961.726993:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 465: rc = 0 00100000:10000000:0.0:1789445961.727349:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 465: rc = 0 00100000:10000000:0.0:1789445961.727599:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 465: rc = 0 00100000:10000000:0.0:1789445961.727914:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 465: rc = 0 00100000:10000000:0.0:1789445961.728207:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 465: rc = 0 00100000:10000000:0.0:1789445961.728451:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 465: rc = 0 00100000:10000000:0.0:1789445961.728712:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 465: rc = 0 00100000:10000000:0.0:1789445961.729154:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 465: rc = 0 00100000:10000000:0.0:1789445961.729397:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 465: rc = 0 00100000:10000000:0.0:1789445961.729640:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 465: rc = 0 00100000:10000000:0.0:1789445961.729985:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 465: rc = 0 00100000:10000000:0.0:1789445961.730434:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 465: rc = 0 00100000:10000000:0.0:1789445961.730679:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 465: rc = 0 00100000:10000000:0.0:1789445961.731016:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 465: rc = 0 00100000:10000000:2.0:1789445961.731489:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 465: rc = 0 00100000:10000000:2.0:1789445961.731735:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 465: rc = 0 00100000:10000000:2.0:1789445961.732256:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 465: rc = 0 00100000:10000000:2.0:1789445961.732510:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 465: rc = 0 00100000:10000000:2.0:1789445961.732751:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 465: rc = 0 00100000:10000000:2.0:1789445961.733311:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 465: rc = 0 00100000:10000000:2.0:1789445961.733564:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 465: rc = 0 00100000:10000000:2.0:1789445961.733940:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 465: rc = 0 00100000:10000000:2.0:1789445961.734318:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 465: rc = 0 00100000:10000000:2.0:1789445961.734561:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 465: rc = 0 00100000:10000000:2.0:1789445961.734994:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 465: rc = 0 00100000:10000000:2.0:1789445961.735363:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 465: rc = 0 00100000:10000000:2.0:1789445961.735603:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 465: rc = 0 00100000:10000000:2.0:1789445961.735943:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 465: rc = 0 00100000:10000000:2.0:1789445961.736357:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 465: rc = 0 00100000:10000000:2.0:1789445961.736708:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 327: rc = 0 00100000:10000000:2.0:1789445961.737420:0:14339:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789445961.737587:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 585: rc = 0 00100000:10000000:2.0:1789445961.737905:0:14339:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789445961.737970:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 585: rc = 0 00100000:10000000:2.0:1789445961.738243:0:14339:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789445961.738307:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 585: rc = 0 00100000:10000000:2.0:1789445961.741110:0:14339:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789445961.741208:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 310: rc = 0 00100000:10000000:2.0:1789445961.741386:0:14339:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789445961.741438:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 310: rc = 0 00100000:10000000:2.0:1789445961.741603:0:14339:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789445961.741655:0:14339:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 310: rc = 0 00000020:00000080:2.0:1789445961.741967:0:14339:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789445961.741974:0:14339:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789445961.741982:0:14339:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1b37c4d4725709e 00000020:01000004:2.0:1789445961.741989:0:14339:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789445961.741994:0:14339:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789445961.742010:0:14339:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9afeada0c800 from MGS 00000020:01000004:2.0:1789445961.742014:0:14339:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789445961.742022:0:14339:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9afeba50cd40) 00000020:00000080:2.0:1789445961.742031:0:14339:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789445961.742154:0:14339:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afeada0c800 from MGS, refs=2 00080000:01000000:2.0:1789445961.742158:0:14339:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789445961.742162:0:14339:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1b37c4d472570ac 00000100:00100000:2.0:1789445961.742240:0:14339:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789445961.742354:0:14339:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789445961.742359:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789445961.742743:0:14339:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789445961.742749:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789445961.743346:0:14339:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789445961.743460:0:14339:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789445961.743469:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789445961.743874:0:14339:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789445961.743880:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789445961.744164:0:14339:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789445961.744169:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789445961.744585:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445961.744587:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445961.744589:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445961.744868:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445961.744871:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445961.744873:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445961.745402:0:14339:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789445961.750995:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789445961.759460:0:14339:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789445961.759478:0:14339:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789445961.759480:0:14339:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789445961.763907:0:14348:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789445961.765086:0:14339:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789445961.765196:0:14339:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789445961.765666:0:14339:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789445961.766958:0:14339:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789445961.767162:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789445961.767168:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789445961.768261:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789445961.768271:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789445961.768599:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789445961.768606:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789445961.769332:0:14339:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789445961.769353:0:14339:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.159@tcp' 00000020:01000004:2.0:1789445961.769354:0:14339:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789445961.769383:0:14339:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.159@tcp (typ=mgc) 00000020:00000080:2.0:1789445961.769395:0:14339:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.159@tcp (ffff9afeba508000) 00000020:00000080:2.0:1789445961.769409:0:14339:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789445961.769479:0:14339:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afd813a3000@MGC192.168.206.159@tcp: add connection 192.168.206.159@tcp at head 00010000:00010000:2.0:1789445961.769619:0:14339:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.159@tcp-0 is initialized 00000040:01000000:2.0:1789445961.769624:0:14339:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.159@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789445961.769890:0:14353:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789445961.776372:0:14354:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789445961.776454:0:14339:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.159@tcp (uuid 7c012be7-6701-48ad-95ae-ff4709bfdc58) 00000020:00000080:2.0:1789445961.776476:0:14339:0:(genops.c:1384:class_connect()) connect: client 7c012be7-6701-48ad-95ae-ff4709bfdc58, cookie 0xc1b37c4d472570ba 00000100:00080000:2.0:1789445961.776487:0:14339:0:(import.c:545:import_select_connection()) MGC192.168.206.159@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789445961.776499:0:14339:0:(import.c:666:import_select_connection()) MGC192.168.206.159@tcp: import ffff9afd813a3000 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:2.0:1789445961.776527:0:14339:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afd81217800 x1876369742057600/t0(0) o250->MGC192.168.206.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789445961.776562:0:14339:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7c012be7-6701-48ad-95ae-ff4709bfdc58->MGS 00000020:01000004:2.0:1789445961.776584:0:14339:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789445961.776590:0:14339:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789445961.776602:0:14339:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9afeba5099c0) 00000020:00000080:2.0:1789445961.776612:0:14339:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789445961.776889:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81217800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c012be7-6701-48ad-95ae-ff4709bfdc58:3309:1876369742057600:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789445961.776948:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445961.777982:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742057600 00000100:00100000:1.0:1789445961.778007:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742057600 00000100:00100000:1.0:1789445961.778072:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789445961.778080:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1876369742057600:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789445961.778109:0:14350:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7c012be7-6701-48ad-95ae-ff4709bfdc58@0@lo t0 exp 0000000000000000 cur 399 last 0 00000020:00000080:1.0:1789445961.778142:0:14350:0:(genops.c:1384:class_connect()) connect: client 7c012be7-6701-48ad-95ae-ff4709bfdc58, cookie 0xc1b37c4d472570c8 00000100:00080000:1.0:1789445961.778290:0:14350:0:(import.c:65:import_set_state_nolock()) ffff9afeb536c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789445961.778386:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+5:3309:x1876369742057600:12345-0@lo:250:mount.lustre.0 Request processed in 304us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445961.778407:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789445961.778463:0:3309:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.159@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789445961.778476:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.159@tcp: connect to target with instance 0 00000100:00080000:1.0:1789445961.778486:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.159@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789445961.778491:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789445961.778494:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afd813a3000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789445961.778497:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789445961.778508:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789445961.778514:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81217800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c012be7-6701-48ad-95ae-ff4709bfdc58:3309:1876369742057600:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789445961.791729:0:14339:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789445961.791990:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789445961.792008:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789445961.792600:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789445961.792607:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789445961.795772:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789445961.795849:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789445961.796682:0:14339:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789445961.796924:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789445961.796929:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789445961.797440:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789445961.797447:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789445961.853826:0:14339:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789445961.854028:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789445961.854034:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789445961.855311:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789445961.855326:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789445961.856248:0:14339:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789445961.856487:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789445961.856493:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789445961.859670:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789445961.859688:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789445961.860384:0:14339:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789445961.860563:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789445961.860569:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789445961.860947:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789445961.860953:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789445961.861617:0:14339:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789445961.861754:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789445961.861760:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789445961.862280:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789445961.862287:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789445961.886908:0:14339:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789445961.887145:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789445961.887151:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789445961.888223:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789445961.888232:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789445961.888875:0:14339:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789445961.888882:0:14339:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789445961.890561:0:14339:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789445961.890584:0:14339:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789445961.890589:0:14339:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.159@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789445961.890717:0:14339:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.159@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789445961.890758:0:14339:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.159@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789445961.890764:0:14339:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789445961.890765:0:14339:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789445961.890767:0:14339:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789445961.890768:0:14339:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789445961.890769:0:14339:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789445961.890771:0:14339:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789445961.890772:0:14339:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789445961.890773:0:14339:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789445961.890774:0:14339:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789445961.890779:0:14339:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789445961.890782:0:14339:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789445961.890784:0:14339:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789445961.890785:0:14339:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789445961.890786:0:14339:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789445961.890787:0:14339:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789445961.890788:0:14339:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789445961.890789:0:14339:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789445961.890789:0:14339:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789445961.890790:0:14339:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789445961.890791:0:14339:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789445961.890792:0:14339:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789445961.890818:0:14339:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789445961.890837:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742057728:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789445961.890908:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445961.890965:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8925f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789445961.891139:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742057728 00000100:00100000:2.0:1789445961.891148:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742057728 00000100:00100000:2.0:1789445961.891192:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789445961.891202:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+5:14339:x1876369742057728:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789445961.891258:0:14352:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789445961.891262:0:14352:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789445961.891265:0:14352:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1789445961.892552:0:14374:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789445961.892994:0:14352:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1789445961.893948:0:14375:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789445961.893954:0:14375:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789445961.893956:0:14375:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789445961.893987:0:14375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1789445961.894361:0:14352:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789445961.894370:0:14352:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789445961.903830:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+5:14339:x1876369742057728:12345-0@lo:253:mount.lustre.0 Request processed in 12619us (12911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445961.903852:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789445961.904116:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742057728:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789445961.904132:0:14339:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789445961.904136:0:14339:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789445961.904137:0:14339:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789445961.904139:0:14339:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789445961.904140:0:14339:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789445961.904141:0:14339:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789445961.904142:0:14339:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789445961.904143:0:14339:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789445961.904145:0:14339:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789445961.904146:0:14339:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789445961.904148:0:14339:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789445961.904166:0:14339:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9afeada0c800 from lustre-MDT0000 10000000:01000000:1.0:1789445961.904273:0:14339:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789445961.904277:0:14339:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789445961.904294:0:14339:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9afeba508000 10000000:01000000:1.0:1789445961.904302:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789445961.904310:0:14339:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9afeba508000 from 1 10000000:01000000:1.0:1789445961.904313:0:14339:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789445961.904355:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe91b6ea00/0xc1b37c4d472570cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445961.904366:0:14339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe91b6ea00/0xc1b37c4d472570cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445961.904377:0:14339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe91b6ea00/0xc1b37c4d472570cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445961.904398:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742057856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789445961.904434:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445961.904460:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8925f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789445961.904523:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742057856 00000100:00100000:0.0:1789445961.904530:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742057856 00000100:00100000:0.0:1789445961.904568:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789445961.904577:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+5:14339:x1876369742057856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789445961.904589:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445961.904603:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afea4906600/0xc1b37c4d472570d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472570cf expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445961.904625:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afea4906600/0xc1b37c4d472570d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472570cf expref: 6 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445961.904635:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afea4906600/0xc1b37c4d472570d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472570cf expref: 6 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445961.904655:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906600, rc 0) 00000100:00100000:0.0:1789445961.904703:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+6:14339:x1876369742057856:12345-0@lo:101:mount.lustre.0 Request processed in 126us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445961.904709:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789445961.904798:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742057856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789445961.904883:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe91b6ea00/0xc1b37c4d472570cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472570d6 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445961.904895:0:14339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe91b6ea00/0xc1b37c4d472570cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472570d6 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445961.904943:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742057984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789445961.904970:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445961.905183:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4c573c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445961.906713:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742057984 00000100:00100000:3.0:1789445961.906727:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742057984 00000100:00100000:3.0:1789445961.906789:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789445961.906801:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+6:14339:x1876369742057984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789445961.907230:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+6:14339:x1876369742057984:12345-0@lo:501:mount.lustre.0 Request processed in 430us (2257us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789445961.907239:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789445961.907554:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742057984:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789445961.907604:0:14339:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789445961.907632:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe91b6ea00/0xc1b37c4d472570cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472570d6 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445961.907642:0:14339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe91b6ea00/0xc1b37c4d472570cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472570d6 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445961.907652:0:14339:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9afeada0c800 10000000:01000000:2.0:1789445961.907656:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789445961.907661:0:14339:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9afeada0c800 10000000:01000000:2.0:1789445961.907663:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789445961.907667:0:14339:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9afeada0c800 from 1 10000000:01000000:2.0:1789445961.907670:0:14339:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789445961.907705:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bec00/0xc1b37c4d472570dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445961.907714:0:14339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afeb57bec00/0xc1b37c4d472570dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445961.907725:0:14339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afeb57bec00/0xc1b37c4d472570dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445961.907748:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742058112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789445961.907789:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445961.907825:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4c573c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445961.907923:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742058112 00000100:00100000:3.0:1789445961.907929:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742058112 00000100:00100000:3.0:1789445961.908011:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789445961.908019:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+6:14339:x1876369742058112:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789445961.908029:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445961.908073:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe8e989e00/0xc1b37c4d472570e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472570dd expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445961.908095:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe8e989e00/0xc1b37c4d472570e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472570dd expref: 7 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445961.908105:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe8e989e00/0xc1b37c4d472570e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472570dd expref: 7 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445961.908113:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989e00, rc 0) 00000100:00100000:3.0:1789445961.908151:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+7:14339:x1876369742058112:12345-0@lo:101:mount.lustre.0 Request processed in 133us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445961.908158:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789445961.908245:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742058112:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789445961.908257:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afeb57bec00/0xc1b37c4d472570dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472570e4 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445961.908266:0:14339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afeb57bec00/0xc1b37c4d472570dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472570e4 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445961.908284:0:14339:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789445961.908294:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bec00/0xc1b37c4d472570dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472570e4 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445961.908302:0:14339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afeb57bec00/0xc1b37c4d472570dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472570e4 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445961.908308:0:14339:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789445961.908312:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789445961.908317:0:14339:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9afeada0c800 10000000:01000000:2.0:1789445961.908319:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789445961.908322:0:14339:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789445961.908325:0:14339:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789445961.908338:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf000/0xc1b37c4d472570eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445961.908345:0:14339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf000/0xc1b37c4d472570eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445961.908352:0:14339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf000/0xc1b37c4d472570eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445961.908363:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742058240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789445961.908388:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445961.908641:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4c573c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445961.908745:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742058240 00000100:00100000:0.0:1789445961.908750:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742058240 00000100:00100000:0.0:1789445961.908776:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789445961.908783:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+7:14339:x1876369742058240:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789445961.908791:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445961.908800:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afea4906000/0xc1b37c4d472570f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472570eb expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445961.908815:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afea4906000/0xc1b37c4d472570f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472570eb expref: 8 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445961.908824:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afea4906000/0xc1b37c4d472570f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472570eb expref: 8 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445961.908831:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906000, rc 0) 00000100:00100000:0.0:1789445961.908872:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+8:14339:x1876369742058240:12345-0@lo:101:mount.lustre.0 Request processed in 90us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445961.908879:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789445961.908960:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742058240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789445961.908972:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf000/0xc1b37c4d472570eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472570f2 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445961.908987:0:14339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf000/0xc1b37c4d472570eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472570f2 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445961.909081:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742058368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789445961.909107:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445961.909121:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4c573c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445961.909246:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742058368 00000100:00100000:0.0:1789445961.909250:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742058368 00000100:00100000:0.0:1789445961.909267:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789445961.909273:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+8:14339:x1876369742058368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789445961.909618:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+9:14339:x1876369742058368:12345-0@lo:501:mount.lustre.0 Request processed in 344us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445961.909632:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789445961.909718:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742058368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789445961.909750:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742058496:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789445961.909789:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445961.909817:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4c573c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445961.909888:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742058496 00000100:00100000:3.0:1789445961.909892:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742058496 00000100:00100000:3.0:1789445961.909914:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789445961.909921:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+9:14339:x1876369742058496:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789445961.910298:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+9:14339:x1876369742058496:12345-0@lo:503:mount.lustre.0 Request processed in 376us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445961.910306:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789445961.910662:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742058496:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789445961.911186:0:14376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c012be7-6701-48ad-95ae-ff4709bfdc58:14376:1876369742058624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789445961.911229:0:14376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445961.911263:0:14376:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4c570c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445961.911433:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742058624 00000100:00100000:3.0:1789445961.911439:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742058624 00000100:00100000:3.0:1789445961.911476:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789445961.911483:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+9:14376:x1876369742058624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789445961.911736:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+9:14376:x1876369742058624:12345-0@lo:502:llog_process_th.0 Request processed in 253us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445961.911744:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789445961.911988:0:14376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c012be7-6701-48ad-95ae-ff4709bfdc58:14376:1876369742058624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789445961.912027:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789445961.912038:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445961.912041:0:14376:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789445961.912077:0:14376:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789445961.912082:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789445961.912098:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9afeba50b380) 00000020:00000080:2.0:1789445961.912118:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789445961.912123:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789445961.912214:0:14376:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789445961.912222:0:14376:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1b37c4d47257100 00000020:00000080:2.0:1789445961.912444:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789445961.912449:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789445961.912452:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445961.912454:0:14376:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789445961.912457:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789445961.912461:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789445961.912462:0:14376:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789445961.912465:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789445961.912481:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9afead9a4d40) 00000020:00000080:2.0:1789445961.912491:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789445961.912497:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789445961.912499:0:14376:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789445961.912502:0:14376:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789445961.912508:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789445961.912548:0:14376:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afeada0c800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789445961.912560:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9afead9a0000) 00000020:00000080:2.0:1789445961.912567:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789445961.912613:0:14376:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789445961.912619:0:14376:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1b37c4d47257115 00000020:00000080:2.0:1789445961.912707:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789445961.912713:0:14376:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789445961.912717:0:14376:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc1b37c4d4725711c 00080000:01000000:2.0:1789445961.912722:0:14376:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789445961.912725:0:14376:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1b37c4d47257123 00010000:00010000:2.0:1789445961.982513:0:14376:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789445961.982962:0:14376:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1789445961.983284:0:14376:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789445961.983851:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9afead9a19c0) 00000020:00000080:2.0:1789445961.983870:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789445961.983959:0:14376:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789445961.983967:0:14376:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1b37c4d47257131 00000020:00000080:3.0:1789445961.984434:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789445961.988411:0:14376:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc1b37c4d47257138 00000020:00000080:0.0:1789445961.992653:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789445961.992666:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789445961.994210:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445961.994215:0:14376:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789445961.994221:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789445961.994228:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445961.994229:0:14376:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789445961.994234:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789445961.994286:0:14376:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789445961.994305:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789445961.994309:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445961.994310:0:14376:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789445961.994313:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789445961.994315:0:14376:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789445961.994316:0:14376:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789445961.994326:0:14376:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789445961.994328:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789445961.994330:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445961.994331:0:14376:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789445961.994333:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789445961.994337:0:14376:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789445961.994339:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445961.994341:0:14376:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789445961.994343:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789445961.994349:0:14376:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.159@tcp to nid 0x20000c0a8ce9f (192.168.206.159@tcp) 00000020:01000000:3.0:1789445961.994373:0:14376:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789445961.994376:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789445961.994389:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9afeb9e50000) 00000020:00000080:3.0:1789445961.994403:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789445961.994408:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789445961.994470:0:14376:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789445961.994475:0:14376:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789445961.994480:0:14376:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1b37c4d47257146 00010000:00080000:3.0:1789445961.994507:0:14376:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afe97419000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.159@tcp at head 00010000:00010000:3.0:1789445961.994703:0:14376:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1789445961.995380:0:14376:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789445961.995425:0:14376:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789445961.996395:0:14376:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789445961.996457:0:14376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789445961.996526:0:14376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789445961.997038:0:14380:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789445961.997180:0:14380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789445961.997830:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789445961.997843:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789445961.997873:0:14376:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789445961.997891:0:14376:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1b37c4d4725714d 00000100:00080000:3.0:1789445961.997901:0:14376:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789445961.997924:0:14376:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9afe97419000 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:3.0:1789445961.997962:0:14376:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afeadb99880 x1876369742058752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789445961.998079:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742058752:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789445961.998136:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876369742058752 offset 0 length 520: 4 00000100:00080000:3.0:1789445961.998253:0:14376:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789445961.998382:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c012be7-6701-48ad-95ae-ff4709bfdc58:3311:1876369742058880:0@lo:400:kworker.0 00000100:00100000:0.0:1789445961.998418:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445961.998466:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742058880 00000100:00100000:0.0:1789445961.998472:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742058880 00000100:00100000:0.0:1789445961.998508:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789445961.998516:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+9:3311:x1876369742058880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445961.998559:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+9:3311:x1876369742058880:12345-0@lo:400:kworker.0 Request processed in 43us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445961.998565:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789445961.998604:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c012be7-6701-48ad-95ae-ff4709bfdc58:3311:1876369742058880:0@lo:400:kworker.0 00000020:01000000:3.0:1789445961.998691:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789445961.998696:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445961.998697:0:14376:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789445961.998701:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789445961.998703:0:14376:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789445961.998705:0:14376:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789445961.998706:0:14376:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789445961.998708:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789445961.998710:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445961.998712:0:14376:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789445961.998714:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789445961.998718:0:14376:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789445961.998721:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445961.998723:0:14376:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789445961.998725:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789445961.998729:0:14376:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.159@tcp to nid 0x20000c0a8ce9f (192.168.206.159@tcp) 00000020:01000000:3.0:1789445961.998749:0:14376:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789445961.998751:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789445961.998763:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9afeb9e519c0) 00000020:00000080:3.0:1789445961.998774:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789445961.998779:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789445961.998833:0:14376:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789445961.998839:0:14376:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789445961.998844:0:14376:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1b37c4d4725715b 00010000:00080000:3.0:1789445961.998869:0:14376:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afebffe2800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.159@tcp at head 00010000:00010000:3.0:1789445961.999299:0:14376:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789445961.999473:0:14376:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789445961.999506:0:14376:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789445962.000435:0:14376:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789445962.000498:0:14376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789445962.000579:0:14376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789445962.001021:0:14382:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789445962.001026:0:14382:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789445962.001851:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789445962.001861:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789445962.001890:0:14376:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789445962.001907:0:14376:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1b37c4d47257162 00000100:00080000:3.0:1789445962.001919:0:14376:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789445962.001932:0:14376:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9afebffe2800 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:3.0:1789445962.001966:0:14376:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afeadb99c00 x1876369742059008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789445962.002040:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742059008:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789445962.002113:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876369742059008 offset 0 length 520: 4 00000100:00080000:3.0:1789445962.002255:0:14376:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789445962.002345:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789445962.002349:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445962.002351:0:14376:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789445962.002354:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789445962.002357:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445962.002358:0:14376:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789445962.002361:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789445962.002363:0:14376:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789445962.002365:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789445962.002367:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445962.002368:0:14376:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789445962.002371:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789445962.002373:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445962.002374:0:14376:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789445962.002377:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789445962.002405:0:14376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c012be7-6701-48ad-95ae-ff4709bfdc58:14376:1876369742059136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789445962.002458:0:14376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445962.002482:0:14376:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb56f5480 going to sleep for 11 seconds 00000100:00100000:1.0:1789445962.002620:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742059136 00000100:00100000:1.0:1789445962.002627:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742059136 00000100:00100000:1.0:1789445962.002703:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789445962.002713:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+9:14376:x1876369742059136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789445962.002958:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+9:14376:x1876369742059136:12345-0@lo:502:llog_process_th.0 Request processed in 246us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445962.002975:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789445962.003099:0:14376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c012be7-6701-48ad-95ae-ff4709bfdc58:14376:1876369742059136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789445962.003127:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789445962.003132:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445962.003134:0:14376:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789445962.003137:0:14376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789445962.003322:0:14339:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1789445962.003348:0:14339:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789445962.003373:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf000/0xc1b37c4d472570eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472570f2 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445962.003383:0:14339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf000/0xc1b37c4d472570eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472570f2 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445962.003392:0:14339:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afeada0c800 from 1 10000000:01000000:2.0:1789445962.003395:0:14339:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789445962.003424:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47257169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445962.003433:0:14339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47257169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445962.003443:0:14339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47257169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445962.003459:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742059264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789445962.003494:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445962.003665:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb5485000 going to sleep for 11 seconds 00000100:00100000:0.0:1789445962.003707:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742059264 00000100:00100000:0.0:1789445962.003713:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742059264 00000100:00100000:0.0:1789445962.003741:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789445962.003748:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+9:14339:x1876369742059264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789445962.003759:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445962.003773:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afea4906200/0xc1b37c4d47257170 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47257169 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445962.003797:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afea4906200/0xc1b37c4d47257170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47257169 expref: 10 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445962.003808:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afea4906200/0xc1b37c4d47257170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47257169 expref: 10 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445962.003826:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906200, rc 0) 00000100:00100000:0.0:1789445962.003901:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+10:14339:x1876369742059264:12345-0@lo:101:mount.lustre.0 Request processed in 153us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445962.003907:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789445962.003992:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742059264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789445962.004018:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47257169 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257170 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445962.004027:0:14339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47257169 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47257170 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445962.004637:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742059392:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789445962.004680:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445962.004744:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeb5485000 going to sleep for 11 seconds 00000100:00100000:0.0:1789445962.004788:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742059392 00000100:00100000:0.0:1789445962.004793:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742059392 00000100:00100000:0.0:1789445962.004828:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789445962.004835:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+10:14339:x1876369742059392:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789445962.004848:0:14352:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789445962.004854:0:14352:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789445962.005124:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+10:14339:x1876369742059392:12345-0@lo:256:mount.lustre.0 Request processed in 289us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445962.005132:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789445962.005219:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742059392:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789445962.005757:0:14339:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789445962.005828:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47257169 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257170 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445962.005839:0:14339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47257169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257170 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789445962.005846:0:14339:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afeada0c800 from 1 10000000:01000000:3.0:1789445962.005848:0:14339:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789445962.005875:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257177 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445962.005882:0:14339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257177 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445962.005891:0:14339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257177 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445962.005907:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742059520:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789445962.005943:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445962.005976:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4f30540 going to sleep for 11 seconds 00000100:00100000:2.0:1789445962.006039:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742059520 00000100:00100000:2.0:1789445962.006178:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742059520 00000100:00100000:2.0:1789445962.006256:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789445962.006265:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+10:14339:x1876369742059520:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789445962.006276:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445962.006292:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afeb57bea00/0xc1b37c4d4725717e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47257177 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445962.006315:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afeb57bea00/0xc1b37c4d4725717e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47257177 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445962.006326:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afeb57bea00/0xc1b37c4d4725717e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47257177 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445962.006334:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bea00, rc 0) 00000100:00100000:2.0:1789445962.006381:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+11:14339:x1876369742059520:12345-0@lo:101:mount.lustre.0 Request processed in 114us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445962.006388:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789445962.006461:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742059520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789445962.006482:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257177 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725717e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445962.006488:0:14339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257177 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d4725717e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445962.006532:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742059648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789445962.006558:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445962.006587:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4f30540 going to sleep for 11 seconds 00000100:00100000:0.0:1789445962.006632:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742059648 00000100:00100000:0.0:1789445962.006636:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742059648 00000100:00100000:0.0:1789445962.006700:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789445962.006708:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+11:14339:x1876369742059648:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789445962.007154:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+11:14339:x1876369742059648:12345-0@lo:501:mount.lustre.0 Request processed in 447us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445962.007162:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789445962.007234:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742059648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789445962.007262:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742059776:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789445962.007301:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445962.007390:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4f30540 going to sleep for 11 seconds 00000100:00100000:2.0:1789445962.007419:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742059776 00000100:00100000:2.0:1789445962.007423:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742059776 00000100:00100000:2.0:1789445962.007444:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789445962.007450:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+11:14339:x1876369742059776:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789445962.007628:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+11:14339:x1876369742059776:12345-0@lo:503:mount.lustre.0 Request processed in 176us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445962.007634:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789445962.007734:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742059776:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789445962.010795:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c012be7-6701-48ad-95ae-ff4709bfdc58:14384:1876369742059904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789445962.010873:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445962.010920:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b3780 going to sleep for 11 seconds 00000100:00100000:2.0:1789445962.011131:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742059904 00000100:00100000:2.0:1789445962.011146:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742059904 00000100:00100000:2.0:1789445962.011195:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789445962.011204:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+11:14384:x1876369742059904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789445962.011480:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+11:14384:x1876369742059904:12345-0@lo:502:llog_process_th.0 Request processed in 277us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445962.011488:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789445962.011655:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c012be7-6701-48ad-95ae-ff4709bfdc58:14384:1876369742059904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789445962.011686:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789445962.011696:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445962.011700:0:14384:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789445962.011706:0:14384:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afeada0c800 00000020:00000080:1.0:1789445962.011708:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789445962.011716:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445962.011719:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445962.011720:0:14384:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789445962.011722:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789445962.011725:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445962.011726:0:14384:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789445962.011729:0:14384:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afeada0c800 00000020:00000080:1.0:1789445962.011731:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789445962.011788:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445962.011792:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445962.011793:0:14384:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789445962.011795:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789445962.011798:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445962.011799:0:14384:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789445962.011803:0:14384:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afeada0c800 00000020:00000080:1.0:1789445962.011805:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789445962.011839:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c012be7-6701-48ad-95ae-ff4709bfdc58:14384:1876369742060032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789445962.011874:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445962.011904:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b3780 going to sleep for 11 seconds 00000100:00100000:2.0:1789445962.014720:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742060032 00000100:00100000:2.0:1789445962.014738:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742060032 00000100:00100000:2.0:1789445962.014848:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789445962.014859:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+11:14384:x1876369742060032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789445962.015190:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+11:14384:x1876369742060032:12345-0@lo:502:llog_process_th.0 Request processed in 333us (3315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445962.015199:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789445962.015312:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c012be7-6701-48ad-95ae-ff4709bfdc58:14384:1876369742060032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789445962.015347:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445962.015355:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445962.015357:0:14384:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789445962.015362:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789445962.016357:0:14339:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789445962.016386:0:14339:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789445962.016412:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257177 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725717e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445962.016426:0:14339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725717e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789445962.016477:0:14339:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789445962.016481:0:14339:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9afeada0c800 10000000:01000000:3.0:1789445962.016485:0:14339:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9afeada0c800 10000000:01000000:3.0:1789445962.016489:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789445962.016497:0:14339:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afeada0c800 from 1 10000000:01000000:3.0:1789445962.016505:0:14339:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789445962.016540:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e988800/0xc1b37c4d47257185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445962.016548:0:14339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe8e988800/0xc1b37c4d47257185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445962.016558:0:14339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe8e988800/0xc1b37c4d47257185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445962.016579:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742060160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789445962.017113:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445962.017154:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8925f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789445962.017245:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742060160 00000100:00100000:2.0:1789445962.017252:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742060160 00000100:00100000:2.0:1789445962.017296:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789445962.017305:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+11:14339:x1876369742060160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789445962.017317:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445962.017330:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afeb57bfc00/0xc1b37c4d4725718c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47257185 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445962.017351:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afeb57bfc00/0xc1b37c4d4725718c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47257185 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445962.017361:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afeb57bfc00/0xc1b37c4d4725718c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47257185 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445962.017377:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bfc00, rc 0) 00000100:00100000:2.0:1789445962.017426:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14339:x1876369742060160:12345-0@lo:101:mount.lustre.0 Request processed in 122us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445962.017432:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789445962.017543:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742060160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789445962.017567:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe8e988800/0xc1b37c4d47257185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725718c expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445962.017577:0:14339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe8e988800/0xc1b37c4d47257185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d4725718c expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445962.017635:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742060288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789445962.017660:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445962.017687:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8925f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789445962.017743:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742060288 00000100:00100000:2.0:1789445962.017748:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742060288 00000100:00100000:2.0:1789445962.017779:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789445962.017785:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14339:x1876369742060288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789445962.018209:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14339:x1876369742060288:12345-0@lo:501:mount.lustre.0 Request processed in 424us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445962.018216:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789445962.018288:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742060288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789445962.018324:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742060416:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789445962.018373:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445962.018411:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8925f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789445962.018463:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742060416 00000100:00100000:2.0:1789445962.018467:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742060416 00000100:00100000:2.0:1789445962.018504:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789445962.018511:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14339:x1876369742060416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789445962.018666:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14339:x1876369742060416:12345-0@lo:503:mount.lustre.0 Request processed in 154us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445962.018673:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789445962.018762:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742060416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789445962.019311:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81217480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c012be7-6701-48ad-95ae-ff4709bfdc58:14387:1876369742060544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789445962.019347:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445962.019372:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742060544 00000100:00100000:0.0:1789445962.019377:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742060544 00000100:00100000:2.0:1789445962.019378:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe90d16e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789445962.019400:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789445962.019409:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14387:x1876369742060544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789445962.019698:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14387:x1876369742060544:12345-0@lo:502:llog_process_th.0 Request processed in 289us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445962.019712:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789445962.020367:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81217480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c012be7-6701-48ad-95ae-ff4709bfdc58:14387:1876369742060544:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789445962.020432:0:14387:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789445962.020446:0:14387:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9afeb9e53380) 00000020:00000080:3.0:1789445962.020469:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1789445962.020554:0:14387:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afeada0c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789445962.020558:0:14387:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afeada0c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789445962.020561:0:14387:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afeada0c800 4 00010000:00080000:3.0:1789445962.020586:0:14387:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afebffe1000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.159@tcp at head 00010000:00010000:3.0:1789445962.029716:0:14387:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1789445962.034366:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789445962.034417:0:14387:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789445962.034435:0:14387:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc1b37c4d4725719a 00000100:00080000:3.0:1789445962.034448:0:14387:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789445962.034463:0:14387:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9afebffe1000 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:3.0:1789445962.034516:0:14387:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afeadb98380 x1876369742060672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789445962.034566:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876369742060672:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789445962.034640:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789445962.034700:0:14387:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789445962.036956:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742060672 00000100:00100000:1.0:1789445962.036969:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742060672 00000100:00100000:1.0:1789445962.037034:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789445962.037463:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876369742060672:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789445962.037567:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876369742060672:12345-0@lo:38:llog_process_th.0 Request processed in 523us (2926us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789445962.037575:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789445962.038396:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789445962.038408:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afebffe1000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789445962.038414:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789445962.038418:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876369742060672:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789445962.039695:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c012be7-6701-48ad-95ae-ff4709bfdc58:14387:1876369742060800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789445962.039786:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445962.039837:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742060800 00000100:00100000:3.0:1789445962.039844:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742060800 00000100:00100000:3.0:1789445962.039880:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789445962.039889:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14387:x1876369742060800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789445962.040186:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14387:x1876369742060800:12345-0@lo:502:llog_process_th.0 Request processed in 297us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445962.040196:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789445962.040637:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8925f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789445962.040658:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c012be7-6701-48ad-95ae-ff4709bfdc58:14387:1876369742060800:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789445962.040687:0:14387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789445962.040853:0:14339:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789445962.040875:0:14339:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789445962.040895:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e988800/0xc1b37c4d47257185 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725718c expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445962.040906:0:14339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe8e988800/0xc1b37c4d47257185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725718c expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789445962.040960:0:14339:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789445962.040963:0:14339:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789445962.040964:0:14339:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789445962.040965:0:14339:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789445962.040967:0:14339:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789445962.040968:0:14339:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789445962.040969:0:14339:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789445962.040971:0:14339:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789445962.040972:0:14339:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789445962.040974:0:14339:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789445962.040979:0:14339:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789445962.040981:0:14339:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789445962.040983:0:14339:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789445962.040984:0:14339:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789445962.040985:0:14339:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789445962.040986:0:14339:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789445962.040987:0:14339:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789445962.040988:0:14339:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789445962.040989:0:14339:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789445962.040990:0:14339:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789445962.040991:0:14339:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789445962.041019:0:14339:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789445962.041032:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742060928:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789445962.041188:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445962.041214:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe90d166c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445962.041424:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742060928 00000100:00100000:0.0:1789445962.041431:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742060928 00000100:00100000:0.0:1789445962.041471:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789445962.041480:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe97068450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14339:x1876369742060928:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789445962.041508:0:14352:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789445962.041523:0:14352:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789445962.086518:0:14352:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789445962.086538:0:14352:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789445962.086656:0:14374:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789445962.086661:0:14374:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789445962.086682:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afe91b6f200/0xc1b37c4d472571a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445962.086700:0:14374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afea4906200/0xc1b37c4d47257170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47257169 expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445962.086709:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afe91b6f200/0xc1b37c4d472571a1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445962.086747:0:14374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afea4906200/0xc1b37c4d47257170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47257169 expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445962.086761:0:14374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afea4906200/0xc1b37c4d47257170 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47257169 expref: 12 pid: 14352 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445962.086775:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1876369742061056:0@lo:104: 00000100:00100000:1.0:1789445962.086857:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445962.086909:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afead822840 going to sleep for 11 seconds 00000100:00100000:3.0:1789445962.087005:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742061056 00000100:00100000:3.0:1789445962.087013:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742061056 00000100:00100000:3.0:1789445962.087087:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789445962.087098:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c012be7-6701-48ad-95ae-ff4709bfdc58+3:14374:x1876369742061056:12345-0@lo:104: 00000100:00100000:0.0:1789445962.087100:0:14341:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789445962.087109:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1789445962.087114:0:14340:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47257169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47257170 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445962.087182:0:14340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789445962.087188:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c012be7-6701-48ad-95ae-ff4709bfdc58+3:14374:x1876369742061056:12345-0@lo:104: Request processed in 93us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445962.087196:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789445962.087216:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789445962.087222:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47257169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47257170 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445962.087229:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be600 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:3.0:1789445962.087234:0:14346:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47257169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47257170 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445962.087254:0:14346:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47257169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47257170 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789445962.087262:0:14346:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47257169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47257170 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789445962.087268:0:14346:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1789445962.087287:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1876369742061056:0@lo:104: 00010000:00010000:3.0:1789445962.087298:0:14346:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47257169 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47257170 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445962.087303:0:14346:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789445962.087307:0:14374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afe91b6f200/0xc1b37c4d472571a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445962.087324:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47257169 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47257170 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445962.087332:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afeb57be600/0xc1b37c4d47257169 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47257170 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445962.087351:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445962.087353:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445962.087355:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445962.087397:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c012be7-6701-48ad-95ae-ff4709bfdc58:3312:1876369742061184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789445962.087425:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445962.087478:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742061184 00000100:00100000:0.0:1789445962.087482:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742061184 00010000:00010000:0.0:1789445962.087500:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afea4906200/0xc1b37c4d47257170 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47257169 expref: 13 pid: 14352 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445962.087520:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789445962.087527:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c012be7-6701-48ad-95ae-ff4709bfdc58+13:3312:x1876369742061184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789445962.087537:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445962.087542:0:14342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afea4906200/0xc1b37c4d47257170 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47257169 expref: 13 pid: 14352 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445962.087553:0:14342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afea4906200/0xc1b37c4d47257170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47257169 expref: 13 pid: 14352 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445962.087575:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afea4906200/0xc1b37c4d47257170 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47257169 expref: 13 pid: 14352 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445962.087586:0:14342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afe91b6f200/0xc1b37c4d472571a1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445962.087594:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe91b6f200/0xc1b37c4d472571a1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789445962.087606:0:14342:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000946481s 00010000:00010000:0.0:1789445962.087610:0:14342:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afe91b6f200/0xc1b37c4d472571a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445962.087616:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afe91b6f200/0xc1b37c4d472571a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445962.087622:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afe91b6f200/0xc1b37c4d472571a1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445962.087628:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afe91b6f200/0xc1b37c4d472571a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445962.087633:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6f200 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445962.087637:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afe91b6f200/0xc1b37c4d472571a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445962.087643:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afe91b6f200/0xc1b37c4d472571a1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445962.087655:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afe91b6f200/0xc1b37c4d472571a1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445962.087669:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445962.087712:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:3312:x1876369742061184:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445962.087718:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789445962.087741:0:14374:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afe91b6f200/0xc1b37c4d472571a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445962.087747:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afe91b6f200/0xc1b37c4d472571a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445962.087752:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe91b6f200/0xc1b37c4d472571a1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445962.087979:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c012be7-6701-48ad-95ae-ff4709bfdc58:3312:1876369742061184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789445962.095931:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe97068450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+11:14339:x1876369742060928:12345-0@lo:253:mount.lustre.0 Request processed in 54446us (54738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445962.095933:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:14339:1876369742060928:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789445962.095943:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 10000000:01000000:2.0:1789445962.095948:0:14339:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789445962.095951:0:14339:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789445962.095953:0:14339:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789445962.095954:0:14339:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789445962.095955:0:14339:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789445962.095956:0:14339:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789445962.095957:0:14339:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789445962.095959:0:14339:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789445962.095960:0:14339:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789445962.095973:0:14339:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789445962.095974:0:14339:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789445962.095988:0:14339:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789445962.101113:0:14339:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789445962.101305:0:14339:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789445962.101596:0:14339:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789445962.101758:0:14339:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789445962.102033:0:14339:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789445962.102520:0:14339:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789445962.103785:0:14339:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789445962.104011:0:14339:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789445962.104629:0:14339:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789445962.104974:0:14339:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789445962.105714:0:14339:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789445962.105921:0:14339:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1789445962.142744:0:14339:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789445962.143483:0:14339:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789445962.143947:0:14399:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789445962.144102:0:14399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1789445962.145984:0:14398:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789445962.145993:0:14398:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1789445962.147586:0:14339:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789445962.147715:0:14339:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789445962.148156:0:14339:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789445962.148169:0:14339:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789445962.149553:0:14399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789445962.149688:0:14399:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789445962.149696:0:14399:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1789445962.151360:0:14339:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789445962.152534:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789445962.153592:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789445962.153784:0:14339:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1789445962.159692:0:14339:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1789445962.171289:0:14339:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789445962.203514:0:14339:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789445962.203562:0:14339:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb24d4154f988 00100000:10000000:2.0:1789445962.203573:0:14339:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789445962.204488:0:14339:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789445962.204503:0:14339:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.159@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789445962.204517:0:14339:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789445962.204543:0:14339:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1789445962.778204:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789445963.101206:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1789445963.482496:0:14354:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789445963.482503:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afeada0c800 from 6 10000000:01000000:3.0:1789445963.482507:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789445963.482554:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e989200/0xc1b37c4d472571a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445963.482567:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe8e989200/0xc1b37c4d472571a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445963.482579:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe8e989200/0xc1b37c4d472571a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445963.482604:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742061312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789445963.482670:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445963.482726:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8513f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445963.482794:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742061312 00000100:00100000:2.0:1789445963.482810:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742061312 00000100:00100000:2.0:1789445963.482859:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789445963.482867:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9706a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+11:14354:x1876369742061312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789445963.482879:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445963.482893:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d472571af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472571a8 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445963.482914:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d472571af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472571a8 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445963.482924:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d472571af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472571a8 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445963.482933:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf600, rc 0) 00000100:00100000:2.0:1789445963.482971:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9706a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14354:x1876369742061312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445963.482976:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789445963.483029:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742061312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789445963.483042:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe8e989200/0xc1b37c4d472571a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472571af expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445963.483073:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe8e989200/0xc1b37c4d472571a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472571af expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445963.483127:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742061440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789445963.483154:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445963.483178:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe854ae000 going to sleep for 11 seconds 00000100:00100000:3.0:1789445963.483928:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742061440 00000100:00100000:3.0:1789445963.483935:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742061440 00000100:00100000:3.0:1789445963.483969:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789445963.483976:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14354:x1876369742061440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789445963.484000:0:14351:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789445963.484016:0:14351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789445963.484019:0:14351:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789445963.484114:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14354:x1876369742061440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445963.484121:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789445963.484281:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742061440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789445963.484322:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789445963.484329:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e989200/0xc1b37c4d472571a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472571af expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445963.484338:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe8e989200/0xc1b37c4d472571a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472571af expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445963.802581:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789445964.130434:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789445964.826188:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445965.854544:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789445965.914604:0:14641:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg659-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789445966.882912:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789445967.454855:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789445967.454861:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789445967.454864:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789445967.454881:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789445967.454883:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789445967.454885:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789445967.454889:0:38:0:(import.c:65:import_set_state_nolock()) ffff9afebffe1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789445967.454907:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9afebffe1000 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:3.0:1789445967.454942:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afeadb9b100 x1876369742061696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789445967.455003:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c012be7-6701-48ad-95ae-ff4709bfdc58:3313:1876369742061568:0@lo:400:kworker.0 00000100:00100000:3.0:1789445967.455117:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445967.455204:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876369742061696:0@lo:38:kworker.0 00000100:00100000:3.0:1789445967.455232:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445967.455264:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742061568 00000100:00100000:3.0:1789445967.455271:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742061568 00000100:00100000:3.0:1789445967.455312:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789445967.455319:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:3313:x1876369742061568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445967.455364:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:3313:x1876369742061568:12345-0@lo:400:kworker.0 Request processed in 45us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445967.455369:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789445967.455411:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c012be7-6701-48ad-95ae-ff4709bfdc58:3313:1876369742061568:0@lo:400:kworker.0 00000100:00100000:1.0:1789445967.459180:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742061696 00000100:00100000:1.0:1789445967.459194:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742061696 00000100:00100000:1.0:1789445967.459243:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789445967.459251:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1876369742061696:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789445967.459276:0:14359:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 405 last 0 00000020:00000080:1.0:1789445967.459464:0:14359:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc1b37c4d472571b6 00000004:00100000:1.0:1789445967.459480:0:14359:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789445967.459634:0:14359:0:(import.c:65:import_set_state_nolock()) ffff9afe9d57d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789445967.459725:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876369742061696:12345-0@lo:38:kworker.0 Request processed in 473us (4490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445967.459734:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789445967.459799:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9afeadb9b100 x1876369742061696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789445977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789445967.459826:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789445967.459837:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789445967.459844:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789445967.459866:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afebffe1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789445967.459874:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876369742061696:0@lo:38:kworker.0 00010000:00010000:3.0:1789445967.899470:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789445968.825283:0:14791:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca633f050 20000000:00000080:1.0:1789445968.825321:0:14791:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9afeba802400 uarg=0000000000000000 20000000:01000000:1.0:1789445968.825367:0:14791:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789445968.825376:0:14791:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789445968.825392:0:14791:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789445968.827119:0:14792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1789445968.827379:0:14791:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789445968.836401:0:14791:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789445968.836433:0:14791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afea4906400/0xc1b37c4d472571bd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445968.836452:0:14791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afeb57bea00/0xc1b37c4d4725717e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47257177 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445968.836460:0:14791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afea4906400/0xc1b37c4d472571bd lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445968.836502:0:14791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afeb57bea00/0xc1b37c4d4725717e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47257177 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445968.836553:0:14791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afeb57bea00/0xc1b37c4d4725717e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47257177 expref: 11 pid: 14350 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445968.836569:0:14791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14791:1876369742061824:0@lo:104: 00000100:00100000:0.0:1789445968.836630:0:14791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445968.836706:0:14791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe82bbdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789445968.836750:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742061824 00000100:00100000:3.0:1789445968.836766:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742061824 00000100:00100000:3.0:1789445968.836852:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789445968.836864:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c012be7-6701-48ad-95ae-ff4709bfdc58+3:14791:x1876369742061824:12345-0@lo:104: 00010000:00010000:3.0:1789445968.836883:0:14341:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d4725717e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445968.838988:0:14791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14791:1876369742061824:0@lo:104: 00010000:00010000:0.0:1789445968.839019:0:14791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afea4906400/0xc1b37c4d472571bd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445968.839113:0:14341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789445968.839131:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c012be7-6701-48ad-95ae-ff4709bfdc58+3:14791:x1876369742061824:12345-0@lo:104: Request processed in 2264us (2495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445968.839145:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789445968.839491:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789445968.839503:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d4725717e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.839515:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988e00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:1.0:1789445968.839520:0:14345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d4725717e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.839531:0:14345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d4725717e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789445968.839539:0:14345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d4725717e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445968.839612:0:14345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789445968.839746:0:14345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257177 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d4725717e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.839754:0:14345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789445968.839800:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257177 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d4725717e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.839809:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257177 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d4725717e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.839830:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445968.839832:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445968.839834:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445968.839888:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c012be7-6701-48ad-95ae-ff4709bfdc58:3310:1876369742061952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789445968.839954:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445968.840146:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742061952 00000100:00100000:1.0:1789445968.840171:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742061952 00010000:00010000:1.0:1789445968.840210:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afeb57bea00/0xc1b37c4d4725717e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47257177 expref: 12 pid: 14350 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445968.840250:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789445968.840261:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:3310:x1876369742061952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789445968.840280:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445968.840287:0:14342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afeb57bea00/0xc1b37c4d4725717e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47257177 expref: 12 pid: 14350 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.840300:0:14342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afeb57bea00/0xc1b37c4d4725717e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47257177 expref: 12 pid: 14350 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.840685:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afeb57bea00/0xc1b37c4d4725717e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47257177 expref: 12 pid: 14350 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.840707:0:14342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afea4906400/0xc1b37c4d472571bd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.840717:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afea4906400/0xc1b37c4d472571bd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.840740:0:14342:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afea4906400/0xc1b37c4d472571bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.840748:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afea4906400/0xc1b37c4d472571bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.840755:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afea4906400/0xc1b37c4d472571bd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.840762:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afea4906400/0xc1b37c4d472571bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.840777:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445968.840793:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afea4906400/0xc1b37c4d472571bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.840802:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afea4906400/0xc1b37c4d472571bd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445968.841225:0:14791:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afea4906400/0xc1b37c4d472571bd lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445968.841235:0:14791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afea4906400/0xc1b37c4d472571bd lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.843245:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afea4906400/0xc1b37c4d472571bd lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.843269:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afea4906400/0xc1b37c4d472571bd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445968.843534:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445968.845240:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c012be7-6701-48ad-95ae-ff4709bfdc58+11:3310:x1876369742061952:12345-0@lo:103:ldlm_bl.0 Request processed in 4967us (5271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445968.845259:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789445968.845853:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c012be7-6701-48ad-95ae-ff4709bfdc58:3310:1876369742061952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789445968.924644:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445969.948978:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789445970.650120:0:14354:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789445970.650128:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afeada0c800 from 10 10000000:01000000:3.0:1789445970.650133:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789445970.650175:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e988c00/0xc1b37c4d472571c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445970.650187:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe8e988c00/0xc1b37c4d472571c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445970.650200:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe8e988c00/0xc1b37c4d472571c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445970.650226:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742062080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789445970.650285:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445970.650341:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afead822d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789445970.650403:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742062080 00000100:00100000:2.0:1789445970.650411:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742062080 00000100:00100000:2.0:1789445970.650460:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789445970.650470:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+11:14354:x1876369742062080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789445970.650481:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445970.650494:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afeb57be600/0xc1b37c4d472571cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472571c4 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445970.650515:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afeb57be600/0xc1b37c4d472571cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472571c4 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445970.650525:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afeb57be600/0xc1b37c4d472571cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472571c4 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445970.650543:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57be600, rc 0) 00000100:00100000:2.0:1789445970.650585:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14354:x1876369742062080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445970.650592:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789445970.650939:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742062080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789445970.650967:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe8e988c00/0xc1b37c4d472571c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472571cb expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445970.650977:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe8e988c00/0xc1b37c4d472571c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472571cb expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445970.651064:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742062208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789445970.651096:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445970.651115:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe83004900 going to sleep for 11 seconds 00000100:00100000:3.0:1789445970.651169:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742062208 00000100:00100000:3.0:1789445970.651173:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742062208 00000100:00100000:3.0:1789445970.651206:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789445970.651214:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14354:x1876369742062208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789445970.651470:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14354:x1876369742062208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445970.651477:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789445970.651506:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742062208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789445970.651537:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742062336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789445970.651572:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445970.651586:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afead822780 going to sleep for 11 seconds 00000100:00100000:3.0:1789445970.651604:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742062336 00000100:00100000:3.0:1789445970.651609:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742062336 00000100:00100000:3.0:1789445970.651628:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789445970.651635:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14354:x1876369742062336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789445970.652183:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:14354:x1876369742062336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 547us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445970.652190:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789445970.652229:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742062336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789445970.658395:0:14869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789445970.658586:0:14354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789445970.658609:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789445970.658619:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e988c00/0xc1b37c4d472571c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472571cb expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445970.658631:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe8e988c00/0xc1b37c4d472571c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472571cb expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445970.970643:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445971.551764:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789445961/real 1789445961] req@ffff9afeadb99880 x1876369742058752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789445971 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445971.551803:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afeadb99880 x1876369742058752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789445971 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789445971.551823:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afe97419000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789445971.551843:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789445971.551847:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742058752:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789445971.551939:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789445971.551964:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789445971.551967:0:38:0:(import.c:65:import_set_state_nolock()) ffff9afe97419000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789445971.551972:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 400 00000100:00080000:1.0:1789445971.551979:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789445971.551991:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9afe97419000 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:1.0:1789445971.552015:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afebffc1f80 x1876369742062592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789445971.552030:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789445971.552034:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789445971.552100:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c012be7-6701-48ad-95ae-ff4709bfdc58:3311:1876369742062464:0@lo:400:kworker.0 00000100:00100000:1.0:1789445971.552191:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445971.552256:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742062720:0@lo:400:kworker.0 00000100:00100000:1.0:1789445971.552290:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445971.552329:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742062464 00000100:00100000:1.0:1789445971.552339:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742062464 00000100:00100000:1.0:1789445971.552389:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789445971.552398:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:3311:x1876369742062464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445971.552458:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:3311:x1876369742062464:12345-0@lo:400:kworker.0 Request processed in 61us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445971.552467:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789445971.552510:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742062720 00000100:00100000:1.0:1789445971.552514:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742062720 00000100:00100000:1.0:1789445971.552539:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789445971.552544:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742062720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445971.552581:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742062720:12345-0@lo:400:kworker.0 Request processed in 36us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445971.552594:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789445971.552633:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9afebffc2680 x1876369742062720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445971.552646:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742062720:0@lo:400:kworker.0 00000100:00100000:1.0:1789445971.552668:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742062592:0@lo:8:kworker.0 00000400:00000100:1.0:1789445971.552689:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876369742062592 offset 0 length 520: 4 00000100:00100000:1.0:1789445971.552715:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c012be7-6701-48ad-95ae-ff4709bfdc58:3311:1876369742062464:0@lo:400:kworker.0 00010000:00010000:2.0:1789445971.997632:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445972.570227:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789445962/real 1789445962] req@ffff9afeadb99c00 x1876369742059008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789445972 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445972.570263:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afeadb99c00 x1876369742059008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789445972 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789445972.570298:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afebffe2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789445972.570323:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789445972.570328:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742059008:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789445972.570466:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789445972.570477:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789445972.570480:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789445972.570483:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789445972.570486:0:38:0:(import.c:65:import_set_state_nolock()) ffff9afebffe2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789445972.570491:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 400 00000100:00080000:0.0:1789445972.570498:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789445972.570511:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9afebffe2800 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:0.0:1789445972.570546:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afeba5cd500 x1876369742062976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789445972.570590:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789445972.570603:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c012be7-6701-48ad-95ae-ff4709bfdc58:3312:1876369742062848:0@lo:400:kworker.0 00000100:00100000:0.0:1789445972.570679:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445972.570749:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742063104:0@lo:400:kworker.0 00000100:00100000:0.0:1789445972.570797:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445972.570851:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742062848 00000100:00100000:0.0:1789445972.570860:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742062848 00000100:00100000:0.0:1789445972.570911:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789445972.570920:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:3312:x1876369742062848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445972.570981:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:3312:x1876369742062848:12345-0@lo:400:kworker.0 Request processed in 61us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445972.570988:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789445972.571042:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742063104 00000100:00100000:0.0:1789445972.571069:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742063104 00000100:00100000:0.0:1789445972.571095:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789445972.571100:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742063104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445972.571150:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742063104:12345-0@lo:400:kworker.0 Request processed in 49us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445972.571157:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789445972.571198:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9afeba5cce00 x1876369742063104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445972.571212:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742063104:0@lo:400:kworker.0 00000100:00100000:0.0:1789445972.571244:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c012be7-6701-48ad-95ae-ff4709bfdc58:3312:1876369742062848:0@lo:400:kworker.0 00000100:00100000:0.0:1789445972.571259:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742062976:0@lo:8:kworker.0 00000400:00000100:0.0:1789445972.571295:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876369742062976 offset 0 length 520: 4 00010000:00010000:2.0:1789445973.049974:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789445973.826285:0:15040:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789445973.826289:0:15040:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789445973.826427:0:15040:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9afeb5c89800 00000020:01000004:2.0:1789445973.826446:0:15040:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789445973.826460:0:15040:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789445973.826476:0:15040:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9afead9a3380) 00000020:00000080:2.0:1789445973.826494:0:15040:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789445973.850887:0:15040:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789445973.851405:0:15040:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789445973.852217:0:15040:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789445973.852553:0:15040:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789445973.853930:0:15040:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789445973.854775:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1789445973.854918:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1789445973.855035:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1789445973.856892:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 642: rc = 0 00100000:10000000:3.0:1789445973.860004:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 642: rc = 0 00100000:10000000:3.0:1789445973.860346:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:3.0:1789445973.860623:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 642: rc = 0 00100000:10000000:3.0:1789445973.860873:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:3.0:1789445973.861303:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00000020:00000080:3.0:1789445973.862418:0:15040:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789445973.862431:0:15040:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789445973.862442:0:15040:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc1b37c4d472571d9 00000020:01000004:3.0:1789445973.862451:0:15040:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789445973.862472:0:15040:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.159@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789445973.862475:0:15040:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789445973.862482:0:15040:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789445973.862486:0:15040:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789445973.862498:0:15040:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9afeb9e54d40) 00000020:00000080:3.0:1789445973.862507:0:15040:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789445973.870959:0:15040:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789445973.871212:0:15040:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789445973.871219:0:15040:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789445973.874911:0:15040:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789445973.874923:0:15040:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789445973.875401:0:15040:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789445973.875407:0:15040:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789445973.876762:0:15040:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789445973.876980:0:15040:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789445973.876987:0:15040:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789445973.880456:0:15040:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789445973.880483:0:15040:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789445973.895211:0:15040:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789445973.895484:0:15040:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789445973.895492:0:15040:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789445973.896708:0:15040:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789445973.896717:0:15040:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789445973.897369:0:15040:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789445973.897376:0:15040:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789445973.899285:0:15040:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789445973.899458:0:15040:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789445973.899464:0:15040:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789445973.899916:0:15040:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789445973.899922:0:15040:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789445973.931345:0:15040:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789445973.932182:0:15040:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789445973.932190:0:15040:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789445973.934160:0:15040:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789445973.934173:0:15040:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789445973.935269:0:15040:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789445973.935295:0:15040:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789445973.935304:0:15040:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.159@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789445973.965524:0:15040:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.159@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789445973.965589:0:15040:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.159@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789445973.965595:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789445973.965596:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789445973.965603:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789445973.965604:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789445973.965605:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789445973.965606:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789445973.965607:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789445973.965608:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789445973.965610:0:15040:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789445973.965614:0:15040:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789445973.965616:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789445973.965617:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789445973.965617:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789445973.965618:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789445973.965619:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789445973.965620:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789445973.965621:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789445973.965622:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789445973.965623:0:15040:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789445973.965652:0:15040:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789445973.966239:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742063232:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789445973.966321:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445973.966466:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742063232 00000100:00100000:1.0:1789445973.966477:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742063232 00000100:00100000:2.0:1789445973.966542:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe83004cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445973.967518:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789445973.967534:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:15040:x1876369742063232:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789445973.967573:0:14352:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789445973.967576:0:14352:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789445973.967580:0:14352:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789445973.990976:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:15040:x1876369742063232:12345-0@lo:253:mount.lustre.0 Request processed in 23438us (24643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445973.990996:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789445973.991028:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742063232:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789445973.991082:0:15040:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789445973.991086:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789445973.991088:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789445973.991090:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789445973.991091:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789445973.991093:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789445973.991094:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789445973.991095:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789445973.991097:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789445973.991099:0:15040:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789445973.991125:0:15040:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9afeb5c89800 from lustre-OST0000 10000000:01000000:0.0:1789445973.991182:0:15040:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789445973.991186:0:15040:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789445973.991194:0:15040:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9afeba508000 local copy 00010000:00010000:0.0:1789445973.991205:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe91b6ea00/0xc1b37c4d472570cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472570d6 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445973.991485:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742063360:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789445973.991526:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445973.991571:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afebfef96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445973.991656:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742063360 00000100:00100000:1.0:1789445973.991664:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742063360 00000100:00100000:1.0:1789445973.991738:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789445973.991747:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:15040:x1876369742063360:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789445973.992011:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:15040:x1876369742063360:12345-0@lo:501:mount.lustre.0 Request processed in 264us (483us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789445973.992019:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789445973.992250:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742063360:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789445973.992269:0:15040:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789445973.992439:0:15040:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789445973.992448:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe91b6ea00/0xc1b37c4d472570cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472570d6 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445973.992458:0:15040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe91b6ea00/0xc1b37c4d472570cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472570d6 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445973.992495:0:15040:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9afeb5c89800 10000000:01000000:2.0:1789445973.992500:0:15040:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789445973.992505:0:15040:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9afeba508000 10000000:01000000:2.0:1789445973.992507:0:15040:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789445973.992510:0:15040:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9afeba508000 from 1 10000000:01000000:2.0:1789445973.992513:0:15040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789445973.992541:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d472571e7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445973.992549:0:15040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d472571e7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445973.992561:0:15040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d472571e7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445973.992577:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742063488:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789445973.992607:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445973.992641:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe83004c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789445973.993014:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742063488 00000100:00100000:1.0:1789445973.993020:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742063488 00000100:00100000:1.0:1789445973.993128:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789445973.993138:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+12:15040:x1876369742063488:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789445973.993153:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445973.993169:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe91b6f800/0xc1b37c4d472571ee lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472571e7 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445973.993196:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe91b6f800/0xc1b37c4d472571ee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472571e7 expref: 13 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445973.993207:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe91b6f800/0xc1b37c4d472571ee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472571e7 expref: 13 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445973.993216:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6f800, rc 0) 00000100:00100000:1.0:1789445973.993265:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+13:15040:x1876369742063488:12345-0@lo:101:mount.lustre.0 Request processed in 128us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445973.993272:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789445973.993356:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742063488:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789445973.993372:0:15040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d472571e7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472571ee expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445973.993382:0:15040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d472571e7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472571ee expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445973.993399:0:15040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789445973.993417:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d472571e7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472571ee expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445973.993436:0:15040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfe00/0xc1b37c4d472571e7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472571ee expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445973.993444:0:15040:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789445973.993447:0:15040:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789445973.993452:0:15040:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789445973.993454:0:15040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789445973.993469:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472571f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445973.993475:0:15040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472571f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445973.993483:0:15040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472571f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445973.993494:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742063616:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789445973.993520:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445973.993546:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe83004c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789445973.993614:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742063616 00000100:00100000:0.0:1789445973.993619:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742063616 00000100:00100000:0.0:1789445973.993651:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789445973.993659:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+13:15040:x1876369742063616:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789445973.993665:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445973.993685:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afea4906200/0xc1b37c4d472571fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472571f5 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445973.993699:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afea4906200/0xc1b37c4d472571fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472571f5 expref: 14 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445973.993709:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afea4906200/0xc1b37c4d472571fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472571f5 expref: 14 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445973.993716:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906200, rc 0) 00000100:00100000:0.0:1789445973.993770:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+14:15040:x1876369742063616:12345-0@lo:101:mount.lustre.0 Request processed in 112us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445973.993776:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789445973.993924:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742063616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789445973.993948:0:15040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472571f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472571fc expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445973.993957:0:15040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472571f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472571fc expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789445973.995488:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789445973.997589:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789445973.997912:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789445973.997971:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789445973.998107:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789445973.998166:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789445973.998206:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789445973.998256:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789445973.998335:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789445973.998344:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789445973.998460:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742063744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789445973.998530:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445973.998585:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe83004cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445973.998632:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742063744 00000100:00100000:3.0:1789445973.998642:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742063744 00000100:00100000:3.0:1789445973.998692:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789445973.998701:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+14:15040:x1876369742063744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789445973.999079:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+14:15040:x1876369742063744:12345-0@lo:501:mount.lustre.0 Request processed in 378us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445973.999087:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789445974.000080:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742063744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789445974.000125:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742063872:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789445974.000175:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445974.000200:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe83004cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445974.000266:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742063872 00000100:00100000:0.0:1789445974.000272:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742063872 00000100:00100000:0.0:1789445974.000317:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789445974.000325:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+14:15040:x1876369742063872:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789445974.000662:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+14:15040:x1876369742063872:12345-0@lo:503:mount.lustre.0 Request processed in 338us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445974.000676:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789445974.001172:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742063872:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789445974.003297:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789445974.003392:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742064000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789445974.003474:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445974.003567:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742064000 00000100:00100000:1.0:1789445974.003576:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742064000 00000100:00100000:3.0:1789445974.003602:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87dde9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445974.003670:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789445974.003682:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+14:15040:x1876369742064000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789445974.003924:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+14:15040:x1876369742064000:12345-0@lo:502:mount.lustre.0 Request processed in 244us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445974.003933:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789445974.004260:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742064000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789445974.004670:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789445974.004736:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789445974.004844:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789445974.004901:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789445974.004964:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789445974.005018:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789445974.005216:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789445974.005618:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789445974.005718:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789445974.006287:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789445974.006339:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789445974.006388:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789445974.006445:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742064128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789445974.007079:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445974.007280:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742064128 00000100:00100000:2.0:1789445974.007290:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742064128 00000100:00100000:3.0:1789445974.007305:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87dde9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445974.007350:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789445974.007371:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+14:15040:x1876369742064128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789445974.007597:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+14:15040:x1876369742064128:12345-0@lo:502:mount.lustre.0 Request processed in 239us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445974.007605:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789445974.007838:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742064128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789445974.007929:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789445974.008616:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789445974.009704:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789445974.009714:0:15054:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789445974.009721:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789445974.009723:0:15054:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789445974.009728:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789445974.009743:0:15054:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9afe85c3b380) 00000020:00000080:3.0:1789445974.009766:0:15054:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789445974.009773:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789445974.009856:0:15054:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afeb5c89800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789445974.009866:0:15054:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789445974.009873:0:15054:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc1b37c4d4725720a 00010000:00010000:3.0:1789445974.014035:0:15054:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789445974.014660:0:15054:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1789445974.016601:0:15054:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789445974.018277:0:15054:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789445974.018294:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445974.018302:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445974.018305:0:15054:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789445974.018319:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789445974.018322:0:15054:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1789445974.018324:0:15054:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789445974.018325:0:15054:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789445974.018327:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789445974.018330:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445974.018331:0:15054:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789445974.018334:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789445974.018337:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445974.018339:0:15054:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789445974.018342:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789445974.018344:0:15054:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789445974.018346:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445974.018348:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445974.018350:0:15054:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789445974.018352:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789445974.018354:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445974.018487:0:15054:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789445974.018495:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789445974.018567:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445974.018571:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445974.018573:0:15054:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789445974.018577:0:15054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789445974.018781:0:15040:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789445974.018808:0:15040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789445974.018829:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472571f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472571fc expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445974.018841:0:15040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afeb57bf200/0xc1b37c4d472571f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472571fc expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445974.018856:0:15040:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afeb5c89800 from 1 10000000:01000000:2.0:1789445974.018859:0:15040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789445974.018891:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57be200/0xc1b37c4d47257211 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445974.018899:0:15040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afeb57be200/0xc1b37c4d47257211 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445974.018909:0:15040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afeb57be200/0xc1b37c4d47257211 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445974.018933:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742064256:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789445974.019007:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445974.019069:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe83004cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445974.019175:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742064256 00000100:00100000:1.0:1789445974.019184:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742064256 00000100:00100000:1.0:1789445974.019230:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789445974.019240:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe89960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+14:15040:x1876369742064256:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789445974.019254:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445974.019270:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe91b6fe00/0xc1b37c4d47257218 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47257211 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445974.019294:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe91b6fe00/0xc1b37c4d47257218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47257211 expref: 15 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445974.019318:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe91b6fe00/0xc1b37c4d47257218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47257211 expref: 15 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445974.019327:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6fe00, rc 0) 00000100:00100000:1.0:1789445974.019388:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe89960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+15:15040:x1876369742064256:12345-0@lo:101:mount.lustre.0 Request processed in 150us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445974.019395:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789445974.019540:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742064256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789445974.019559:0:15040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afeb57be200/0xc1b37c4d47257211 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257218 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445974.019568:0:15040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afeb57be200/0xc1b37c4d47257211 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47257218 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789445974.020104:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789445974.020434:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789445974.020692:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789445974.020746:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789445974.020814:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789445974.020822:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789445974.020894:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742064384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789445974.020958:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445974.020996:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87dde3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445974.021281:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742064384 00000100:00100000:2.0:1789445974.021289:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742064384 00000100:00100000:2.0:1789445974.021333:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789445974.021342:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe89960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+15:15040:x1876369742064384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789445974.021620:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe89960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+15:15040:x1876369742064384:12345-0@lo:501:mount.lustre.0 Request processed in 278us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445974.021628:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789445974.021793:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742064384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789445974.021828:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742064512:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789445974.021870:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445974.021892:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87dde3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445974.021988:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742064512 00000100:00100000:2.0:1789445974.021993:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742064512 00000100:00100000:2.0:1789445974.022077:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789445974.022084:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe89961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+15:15040:x1876369742064512:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789445974.022232:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe89961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+15:15040:x1876369742064512:12345-0@lo:503:mount.lustre.0 Request processed in 148us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445974.022249:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789445974.022351:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742064512:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789445974.022860:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789445974.022953:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742064640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789445974.023000:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445974.023297:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87dde3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445974.023342:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742064640 00000100:00100000:1.0:1789445974.023349:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742064640 00000100:00100000:1.0:1789445974.023449:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789445974.023458:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe89962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+15:15040:x1876369742064640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789445974.023744:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe89962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+15:15040:x1876369742064640:12345-0@lo:502:mount.lustre.0 Request processed in 287us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445974.023753:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789445974.023872:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742064640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789445974.024503:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789445974.024568:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789445974.024647:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789445974.024693:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789445974.024732:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789445974.024786:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789445974.024825:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789445974.024860:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789445974.024902:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742064768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789445974.026601:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445974.026729:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87dde3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445974.029330:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742064768 00000100:00100000:2.0:1789445974.029344:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742064768 00000100:00100000:2.0:1789445974.030523:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789445974.030536:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe89963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+15:15040:x1876369742064768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789445974.030873:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe89963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+15:15040:x1876369742064768:12345-0@lo:502:mount.lustre.0 Request processed in 338us (4276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445974.030881:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789445974.031071:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742064768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789445974.031236:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789445974.031253:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789445974.035520:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789445974.035534:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789445974.035537:0:15058:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789445974.035543:0:15058:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afeb5c89800 00000020:00000080:0.0:1789445974.035546:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789445974.035556:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789445974.035558:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789445974.035560:0:15058:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789445974.035562:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789445974.035564:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789445974.035565:0:15058:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789445974.035569:0:15058:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afeb5c89800 00000020:00000080:0.0:1789445974.035571:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789445974.036316:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789445974.036329:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789445974.036330:0:15058:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789445974.036333:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789445974.036336:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789445974.036338:0:15058:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789445974.036341:0:15058:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afeb5c89800 00000020:00000080:0.0:1789445974.036343:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789445974.043933:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789445974.043955:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789445974.043957:0:15058:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789445974.043969:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789445974.044485:0:15040:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789445974.044518:0:15040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789445974.044984:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57be200/0xc1b37c4d47257211 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257218 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445974.044999:0:15040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afeb57be200/0xc1b37c4d47257211 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257218 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445974.045075:0:15040:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789445974.045078:0:15040:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9afeb5c89800 10000000:01000000:2.0:1789445974.045082:0:15040:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9afeb5c89800 10000000:01000000:2.0:1789445974.045087:0:15040:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789445974.045093:0:15040:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afeb5c89800 from 1 10000000:01000000:2.0:1789445974.045096:0:15040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789445974.045140:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57be000/0xc1b37c4d4725721f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445974.045149:0:15040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afeb57be000/0xc1b37c4d4725721f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445974.045161:0:15040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afeb57be000/0xc1b37c4d4725721f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445974.045201:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742064896:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789445974.045283:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445974.045383:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742064896 00000100:00100000:1.0:1789445974.045391:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742064896 00000100:00100000:1.0:1789445974.045441:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789445974.045451:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe96264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+15:15040:x1876369742064896:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789445974.045464:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445974.045476:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe91b6e000/0xc1b37c4d47257226 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d4725721f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445974.045504:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe91b6e000/0xc1b37c4d47257226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d4725721f expref: 16 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445974.045515:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe91b6e000/0xc1b37c4d47257226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d4725721f expref: 16 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445974.045536:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe91b6e000, rc 0) 00000100:00100000:1.0:1789445974.045622:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe96264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:15040:x1876369742064896:12345-0@lo:101:mount.lustre.0 Request processed in 171us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445974.045628:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789445974.051597:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe98a810c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445974.051653:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742064896:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789445974.051686:0:15040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afeb57be000/0xc1b37c4d4725721f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257226 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445974.051705:0:15040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afeb57be000/0xc1b37c4d4725721f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47257226 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789445974.052736:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789445974.053523:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789445974.054000:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789445974.054077:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789445974.054128:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789445974.054186:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789445974.054229:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789445974.054286:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789445974.054326:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789445974.054361:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789445974.054417:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789445974.054452:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789445974.054486:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789445974.054532:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789445974.054566:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789445974.054600:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789445974.054676:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789445974.054716:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789445974.054756:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789445974.054830:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789445974.054878:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789445974.054928:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789445974.055120:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789445974.055204:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789445974.055295:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789445974.055398:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789445974.055474:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789445974.055541:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789445974.055986:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789445974.056229:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789445974.056401:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789445974.056413:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789445974.056590:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742065024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789445974.056684:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445974.056729:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742065024 00000100:00100000:0.0:1789445974.056739:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742065024 00000100:00100000:2.0:1789445974.056751:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe98a810c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445974.056794:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789445974.056804:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe96264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:15040:x1876369742065024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789445974.057103:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe96264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:15040:x1876369742065024:12345-0@lo:501:mount.lustre.0 Request processed in 299us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445974.057111:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789445974.057168:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742065024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789445974.057213:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742065152:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789445974.057284:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445974.057324:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe98a810c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445974.058512:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742065152 00000100:00100000:3.0:1789445974.058524:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742065152 00000100:00100000:3.0:1789445974.058581:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789445974.058590:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe96267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:15040:x1876369742065152:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789445974.058836:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe96267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:15040:x1876369742065152:12345-0@lo:503:mount.lustre.0 Request processed in 247us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445974.058844:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789445974.059074:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742065152:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789445974.061173:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789445974.061348:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742065280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789445974.061435:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445974.061502:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe98a810c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445974.061555:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742065280 00000100:00100000:0.0:1789445974.061565:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742065280 00000100:00100000:0.0:1789445974.062194:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789445974.062208:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:15040:x1876369742065280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789445974.062508:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:15040:x1876369742065280:12345-0@lo:502:mount.lustre.0 Request processed in 304us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445974.062516:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789445974.066188:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742065280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789445974.066788:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789445974.066919:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789445974.066983:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789445974.067120:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789445974.067159:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789445974.067213:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789445974.067254:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789445974.067341:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789445974.067422:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789445974.067488:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789445974.067558:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789445974.067643:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789445974.067710:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789445974.067799:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789445974.067931:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789445974.067988:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789445974.068092:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789445974.068189:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789445974.068228:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789445974.068262:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789445974.068310:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789445974.068357:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789445974.068398:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789445974.068461:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789445974.068529:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789445974.068597:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789445974.070546:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789445974.070643:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789445974.070680:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789445974.070737:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789445974.070793:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789445974.070829:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789445974.070877:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789445974.070934:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789445974.070997:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789445974.071095:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789445974.071141:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789445974.071184:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789445974.071361:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789445974.071403:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789445974.071452:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742065408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789445974.071535:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445974.071584:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe98a810c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445974.071669:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742065408 00000100:00100000:3.0:1789445974.071677:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742065408 00000100:00100000:3.0:1789445974.071731:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789445974.071759:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:15040:x1876369742065408:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789445974.071982:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:15040:x1876369742065408:12345-0@lo:502:mount.lustre.0 Request processed in 243us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445974.072000:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789445974.072439:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742065408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789445974.072528:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789445974.072546:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789445974.074427:0:15063:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789445974.074441:0:15063:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9afeb57c0000) 00000020:00000080:1.0:1789445974.074462:0:15063:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789445974.074531:0:15063:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afeb5c89800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789445974.074535:0:15063:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afeb5c89800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789445974.074537:0:15063:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afeb5c89800 3 00010000:00080000:1.0:1789445974.074577:0:15063:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afe9fa28800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.159@tcp at head 00010000:00010000:1.0:1789445974.076970:0:15063:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1789445974.077281:0:15063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789445974.077324:0:15063:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789445974.077340:0:15063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc1b37c4d47257234 00000100:00080000:1.0:1789445974.077351:0:15063:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789445974.078580:0:15063:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9afe9fa28800 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:1.0:1789445974.078633:0:15063:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afebffc0380 x1876369742065536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789445974.078672:0:15063:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789445974.078754:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789445974.078759:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789445974.078762:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789445974.078765:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789445974.078861:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876369742065664:0@lo:400:kworker.0 00000100:00100000:1.0:1789445974.078931:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445974.078997:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742065664 00000100:00100000:1.0:1789445974.079004:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742065664 00000100:00100000:1.0:1789445974.079072:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789445974.079081:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876369742065664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445974.079140:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876369742065664:12345-0@lo:400:kworker.0 Request processed in 60us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445974.079147:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789445974.079185:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9afeadb9b480 x1876369742065664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445974.079198:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876369742065664:0@lo:400:kworker.0 00000100:00100000:0.0:1789445974.079336:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876369742065536:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789445974.079382:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445974.079444:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742065536 00000100:00100000:0.0:1789445974.079449:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742065536 00000100:00100000:0.0:1789445974.079473:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789445974.079478:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876369742065536:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789445974.079502:0:14357:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:0.0:1789445974.079549:0:14357:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc1b37c4d4725723b 00000004:00100000:0.0:1789445974.079566:0:14357:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789445974.079593:0:14357:0:(import.c:65:import_set_state_nolock()) ffff9afe9ee68800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789445974.079632:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876369742065536:12345-0@lo:38:llog_process_th.0 Request processed in 152us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445974.079645:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789445974.079675:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9afebffc0380 x1876369742065536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789445984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445974.079683:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789445974.079690:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789445974.079698:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789445974.079702:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789445974.079704:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afe9fa28800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789445974.079710:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876369742065536:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789445974.086412:0:15063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1789445974.086891:0:15040:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789445974.086927:0:15040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789445974.086952:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57be000/0xc1b37c4d4725721f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257226 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445974.086964:0:15040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afeb57be000/0xc1b37c4d4725721f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257226 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789445974.087025:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789445974.087028:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789445974.087030:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789445974.087031:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789445974.087033:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789445974.087034:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789445974.087035:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789445974.087037:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789445974.087039:0:15040:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789445974.087059:0:15040:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789445974.087062:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789445974.087064:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789445974.087071:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789445974.087072:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789445974.087073:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789445974.087074:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789445974.087075:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789445974.087076:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789445974.087077:0:15040:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789445974.087106:0:15040:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789445974.087130:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742065792:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789445974.087208:0:15040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445974.087251:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742065792 00000100:00100000:2.0:1789445974.087260:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742065792 00000100:00100000:2.0:1789445974.087321:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789445974.087331:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:15040:x1876369742065792:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789445974.087377:0:14352:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789445974.087407:0:14352:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789445974.088262:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe98a810c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789445974.110709:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1789445974.129468:0:14352:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789445974.129490:0:14352:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789445974.129902:0:14374:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789445974.129908:0:14374:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789445974.129933:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257242 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445974.129965:0:14374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d472571af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472571a8 expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445974.129975:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257242 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445974.130020:0:14374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d472571af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d472571a8 expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445974.130036:0:14374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d472571af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d472571a8 expref: 16 pid: 14350 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445974.130097:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81217b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1876369742065920:0@lo:104: 00000100:00100000:2.0:1789445974.130168:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445974.130217:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe98a816c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445974.130315:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742065920 00000100:00100000:0.0:1789445974.130324:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742065920 00000100:00100000:0.0:1789445974.130453:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789445974.130463:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81215180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c012be7-6701-48ad-95ae-ff4709bfdc58+3:14374:x1876369742065920:12345-0@lo:104: 00010000:00010000:0.0:1789445974.130477:0:14340:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe8e989200/0xc1b37c4d472571a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d472571af expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445974.130619:0:14340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789445974.130627:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81215180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c012be7-6701-48ad-95ae-ff4709bfdc58+3:14374:x1876369742065920:12345-0@lo:104: Request processed in 165us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445974.130634:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789445974.130973:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445974.130980:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe8e989200/0xc1b37c4d472571a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d472571af expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445974.130988:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989200 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1789445974.130993:0:14346:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e989200/0xc1b37c4d472571a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d472571af expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445974.131008:0:14346:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe8e989200/0xc1b37c4d472571a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d472571af expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789445974.131015:0:14346:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e989200/0xc1b37c4d472571a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d472571af expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445974.131022:0:14346:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789445974.131089:0:14346:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe8e989200/0xc1b37c4d472571a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d472571af expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445974.131098:0:14346:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789445974.131127:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe8e989200/0xc1b37c4d472571a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d472571af expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445974.131136:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe8e989200/0xc1b37c4d472571a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d472571af expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445974.131156:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445974.131171:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445974.131173:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c012be7-6701-48ad-95ae-ff4709bfdc58:3312:1876369742066048:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789445974.131174:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445974.131219:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445974.131225:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81217b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1876369742065920:0@lo:104: 00010000:00010000:2.0:1789445974.131250:0:14374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257242 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445974.131333:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742066048 00000100:00100000:0.0:1789445974.131339:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742066048 00010000:00010000:0.0:1789445974.131440:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d472571af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d472571a8 expref: 17 pid: 14350 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445974.131470:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789445974.131487:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c012be7-6701-48ad-95ae-ff4709bfdc58+17:3312:x1876369742066048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789445974.131500:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789445974.131506:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d472571af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d472571a8 expref: 17 pid: 14350 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445974.131517:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d472571af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d472571a8 expref: 17 pid: 14350 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445974.131990:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d472571af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d472571a8 expref: 17 pid: 14350 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445974.132006:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257242 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445974.132014:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257242 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789445974.132029:0:14344:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002122369s 00010000:00010000:0.0:1789445974.132034:0:14344:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257242 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445974.132041:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257242 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445974.132110:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257242 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445974.132117:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257242 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445974.132124:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445974.132137:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257242 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445974.132146:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257242 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445974.132160:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257242 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445974.132171:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789445974.132222:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:3312:x1876369742066048:12345-0@lo:103:ldlm_bl.0 Request processed in 736us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445974.132230:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789445974.132267:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c012be7-6701-48ad-95ae-ff4709bfdc58:3312:1876369742066048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789445974.133243:0:14374:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257242 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445974.133257:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257242 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445974.133263:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257242 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445974.149611:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+15:15040:x1876369742065792:12345-0@lo:253:mount.lustre.0 Request processed in 62259us (62379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445974.149627:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789445974.150131:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15040:1876369742065792:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789445974.150147:0:15040:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789445974.150150:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789445974.150152:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789445974.150154:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789445974.150155:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789445974.150157:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789445974.150158:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789445974.150160:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789445974.150161:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789445974.150163:0:15040:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789445974.150179:0:15040:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789445974.157488:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789445974.157857:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789445974.158039:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789445974.159860:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789445974.160211:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789445974.160906:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789445974.162212:0:15040:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789445974.222980:0:15040:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789445974.222993:0:15040:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789445974.223036:0:15040:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789445974.223188:0:15040:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.159@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789445974.223206:0:15040:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789445974.223243:0:15040:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:00080000:2.0:1789445974.364569:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789445975.130257:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789445975.899832:0:14354:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789445975.899839:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afeada0c800 from 7 10000000:01000000:1.0:1789445975.899844:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789445975.899900:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe91b6fc00/0xc1b37c4d47257249 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445975.899911:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe91b6fc00/0xc1b37c4d47257249 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445975.899922:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe91b6fc00/0xc1b37c4d47257249 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445975.899955:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742066176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789445975.900018:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445975.900084:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b3240 going to sleep for 11 seconds 00000100:00100000:2.0:1789445975.900223:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742066176 00000100:00100000:2.0:1789445975.900231:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742066176 00000100:00100000:2.0:1789445975.900289:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789445975.900300:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+15:14354:x1876369742066176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789445975.900315:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445975.900331:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d47257250 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47257249 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445975.900367:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d47257250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47257249 expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445975.900379:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d47257250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47257249 expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445975.900388:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bf600, rc 0) 00000100:00100000:2.0:1789445975.900426:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:14354:x1876369742066176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445975.900434:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789445975.900525:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742066176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789445975.900543:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe91b6fc00/0xc1b37c4d47257249 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257250 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445975.900562:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe91b6fc00/0xc1b37c4d47257249 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47257250 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445975.900614:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742066304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789445975.900646:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445975.900674:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b3240 going to sleep for 11 seconds 00000100:00100000:2.0:1789445975.902172:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742066304 00000100:00100000:2.0:1789445975.902187:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742066304 00000100:00100000:2.0:1789445975.902238:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789445975.902247:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:14354:x1876369742066304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789445975.902271:0:14352:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789445975.902287:0:14352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789445975.902291:0:14352:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789445975.902402:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:14354:x1876369742066304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445975.902410:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789445975.902524:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742066304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789445975.902586:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789445975.902596:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe91b6fc00/0xc1b37c4d47257249 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257250 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445975.902606:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe91b6fc00/0xc1b37c4d47257249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257250 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445976.167521:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445977.178168:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445978.202622:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789445979.227490:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789445979.227497:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789445979.227500:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789445979.227503:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789445979.229078:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c012be7-6701-48ad-95ae-ff4709bfdc58:3313:1876369742066432:0@lo:400:kworker.0 00000100:00100000:3.0:1789445979.229155:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445979.229234:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876369742066688:0@lo:400:kworker.0 00000100:00100000:3.0:1789445979.229266:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445979.229284:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789445979.229291:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876369742066560:0@lo:400:kworker.0 00000100:00100000:3.0:1789445979.229311:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445979.229335:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742066432 00000100:00100000:3.0:1789445979.229342:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742066432 00000100:00100000:3.0:1789445979.229390:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789445979.229399:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:3313:x1876369742066432:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1789445979.230708:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445979.230742:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742066688 00000100:00100000:0.0:1789445979.230750:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742066688 00000100:00100000:0.0:1789445979.230805:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742066560 00000100:00100000:0.0:1789445979.230809:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742066560 00000100:00100000:0.0:1789445979.230826:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789445979.230834:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876369742066688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445979.230930:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876369742066688:12345-0@lo:400:kworker.0 Request processed in 97us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445979.230938:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789445979.230956:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789445979.230962:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876369742066560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445979.230989:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876369742066560:12345-0@lo:400:kworker.0 Request processed in 29us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445979.230994:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789445979.231025:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789445979.231084:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afeadb9b480 x1876369742066560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445979.231097:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876369742066560:0@lo:400:kworker.0 00010000:00080000:0.0:1789445979.231109:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afeadb99c00 x1876369742066688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789445995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445979.231117:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876369742066688:0@lo:400:kworker.0 00000100:00100000:3.0:1789445979.231280:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:3313:x1876369742066432:12345-0@lo:400:kworker.0 Request processed in 1881us (2124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445979.231289:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789445979.233522:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c012be7-6701-48ad-95ae-ff4709bfdc58:3313:1876369742066432:0@lo:400:kworker.0 00010000:00010000:0.0:1789445980.250371:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789445980.381983:0:15410:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg659-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789445981.275029:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445982.305016:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445983.331653:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445984.346276:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789445984.346918:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789445984.346924:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789445984.346927:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789445984.346930:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789445984.346968:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742067072:0@lo:400:kworker.0 00000100:00100000:2.0:1789445984.347074:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445984.347147:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742067072 00000100:00100000:2.0:1789445984.347155:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742067072 00000100:00100000:2.0:1789445984.347203:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789445984.347211:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742067072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445984.347256:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742067072:12345-0@lo:400:kworker.0 Request processed in 46us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445984.347262:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789445984.347281:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789445984.347306:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afd81215f80 x1876369742067072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445984.347320:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742067072:0@lo:400:kworker.0 00000100:00100000:1.0:1789445984.347393:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c012be7-6701-48ad-95ae-ff4709bfdc58:3312:1876369742066816:0@lo:400:kworker.0 00000100:00100000:1.0:1789445984.347425:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445984.347455:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789445984.347460:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742066944:0@lo:400:kworker.0 00000100:00100000:1.0:1789445984.347479:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445984.347503:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742066944 00000100:00100000:1.0:1789445984.347507:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742066944 00000100:00100000:1.0:1789445984.347526:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789445984.347532:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742066944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445984.347561:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742066944:12345-0@lo:400:kworker.0 Request processed in 29us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445984.347577:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789445984.347601:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afd81217b80 x1876369742066944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445984.347610:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742066944:0@lo:400:kworker.0 00000100:00100000:2.0:1789445984.347938:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742066816 00000100:00100000:2.0:1789445984.347943:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742066816 00000100:00100000:2.0:1789445984.347966:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789445984.347972:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f97c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:3312:x1876369742066816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445984.348008:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f97c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:3312:x1876369742066816:12345-0@lo:400:kworker.0 Request processed in 35us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445984.348014:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789445984.348144:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c012be7-6701-48ad-95ae-ff4709bfdc58:3312:1876369742066816:0@lo:400:kworker.0 00000040:00080000:1.0:1789445984.604356:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789445985.387090:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445986.330213:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789445971/real 1789445971] req@ffff9afebffc1f80 x1876369742062592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789445986 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445986.330258:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afebffc1f80 x1876369742062592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789445986 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789445986.330285:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afe97419000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789445986.330317:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789445986.330322:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742062592:0@lo:8:kworker.0 00000100:00080000:2.0:1789445986.330617:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789445986.330623:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789445986.330626:0:8:0:(import.c:65:import_set_state_nolock()) ffff9afe97419000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789445986.330632:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 409 00000100:00080000:2.0:1789445986.330639:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789445986.330651:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9afe97419000 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:2.0:1789445986.330675:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afd81216d80 x1876369742067328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789445986.330729:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789445986.330733:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789445986.330950:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c012be7-6701-48ad-95ae-ff4709bfdc58:3311:1876369742067200:0@lo:400:kworker.0 00000100:00100000:3.0:1789445986.331039:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445986.331148:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81217480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369742067584:0@lo:400:kworker.0 00000100:00100000:3.0:1789445986.331179:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445986.331201:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789445986.331206:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876369742067456:0@lo:400:kworker.0 00000100:00100000:3.0:1789445986.331224:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445986.331258:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742067584 00000100:00100000:3.0:1789445986.331266:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742067584 00000100:00100000:3.0:1789445986.331321:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742067456 00000100:00100000:3.0:1789445986.331324:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742067456 00000100:00100000:3.0:1789445986.331339:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789445986.331348:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369742067584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445986.331400:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369742067584:12345-0@lo:400:kworker.0 Request processed in 53us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445986.331407:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789445986.331424:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789445986.331429:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876369742067456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445986.331458:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876369742067456:12345-0@lo:400:kworker.0 Request processed in 29us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445986.331464:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789445986.331483:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789445986.331512:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afd81216680 x1876369742067456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445986.331527:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876369742067456:0@lo:400:kworker.0 00010000:00080000:3.0:1789445986.331536:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afd81217480 x1876369742067584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445986.331545:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81217480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369742067584:0@lo:400:kworker.0 00000100:00100000:2.0:1789445986.331630:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742067200 00000100:00100000:2.0:1789445986.331635:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742067200 00000100:00100000:2.0:1789445986.331668:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789445986.331675:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:3311:x1876369742067200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445986.331711:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:3311:x1876369742067200:12345-0@lo:400:kworker.0 Request processed in 38us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445986.331717:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789445986.332035:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c012be7-6701-48ad-95ae-ff4709bfdc58:3311:1876369742067200:0@lo:400:kworker.0 00000100:00100000:1.0:1789445986.332287:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742067328:0@lo:8:kworker.0 00000100:00100000:1.0:1789445986.332337:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445986.332779:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742067328 00000100:00100000:3.0:1789445986.332786:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742067328 00000100:00100000:3.0:1789445986.332816:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789445986.332822:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876369742067328:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789445986.332852:0:15042:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:3.0:1789445986.332900:0:15042:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1b37c4d47257257 00002000:00100000:3.0:1789445986.332917:0:15042:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9afebfa49000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789445986.332922:0:15042:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789445986.332925:0:15042:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789445986.333353:0:15042:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789445986.333383:0:15042:0:(import.c:65:import_set_state_nolock()) ffff9afebfa4e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789445986.333718:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876369742067328:12345-0@lo:8:kworker.0 Request processed in 894us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445986.333727:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789445986.334985:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afd81216d80 x1876369742067328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789446006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445986.335003:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789445986.335016:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789445986.335028:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789445986.335036:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789445986.335039:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afe97419000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789445986.335081:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789445986.335089:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742067328:0@lo:8:kworker.0 00000004:00080000:0.0:1789445986.335287:0:14381:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1789445986.335319:0:14381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14381:1876369742067840:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789445986.335381:0:14381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445986.335431:0:14381:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896abf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789445986.335643:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742067712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789445986.335680:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445986.335925:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742067840 00000100:00100000:1.0:1789445986.335935:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742067840 00000100:00100000:1.0:1789445986.336002:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789445986.336011:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14381:x1876369742067840:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1789445986.337412:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789445986.337714:0:14380:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789445986.338015:0:14380:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424359968916ns, next at 0ns, rc = 0 00002000:00080000:1.0:1789445986.341355:0:15044:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789445986.341370:0:15044:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789445986.341376:0:15044:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1789445986.351273:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.351290:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba73b51/0xc1b37c4d4725725e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.351316:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.351321:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.351330:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fba73b51/0xc1b37c4d4725725e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.351352:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fba73b51/0xc1b37c4d4725725e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.351366:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba73b51/0xc1b37c4d4725725e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.351376:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fba73b51/0xc1b37c4d4725725e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.351409:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789445986.353378:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789445986.353392:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fba73b51/0xc1b37c4d4725725e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.353407:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6f200 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445986.353414:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba73b51/0xc1b37c4d4725725e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.353428:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba73b51/0xc1b37c4d4725725e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.353488:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fba73b51/0xc1b37c4d4725725e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.353497:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fba73b51/0xc1b37c4d4725725e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.353536:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445986.353538:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445986.353540:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789445986.354363:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.354376:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d47257265 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.354392:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.354397:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.354406:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d47257265 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.354436:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d47257265 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.354448:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d47257265 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.354456:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d47257265 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.354484:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789445986.355041:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.355076:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000857f7bac/0xc1b37c4d4725726c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.355086:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.355089:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.355093:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000857f7bac/0xc1b37c4d4725726c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.355103:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000857f7bac/0xc1b37c4d4725726c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.355111:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000857f7bac/0xc1b37c4d4725726c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.355131:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000857f7bac/0xc1b37c4d4725726c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.355145:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789445986.355542:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.355548:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eeae283/0xc1b37c4d47257273 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.355557:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.355561:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.355565:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eeae283/0xc1b37c4d47257273 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.355574:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eeae283/0xc1b37c4d47257273 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.355583:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eeae283/0xc1b37c4d47257273 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.355590:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eeae283/0xc1b37c4d47257273 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.355598:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1789445986.356128:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742067712 00000100:00100000:1.0:1789445986.356138:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742067712 00000100:00100000:1.0:1789445986.356213:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789445986.356229:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1876369742067712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789445986.356265:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789445986.356353:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1876369742067712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (20671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445986.356360:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789445986.356415:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742067712:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1789445986.356560:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.356566:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000096313b1/0xc1b37c4d4725727a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.356576:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.356579:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.356584:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000096313b1/0xc1b37c4d4725727a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.356593:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000096313b1/0xc1b37c4d4725727a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.356601:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000096313b1/0xc1b37c4d4725727a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.356608:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000096313b1/0xc1b37c4d4725727a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.356617:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1789445986.356982:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789445986.356996:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d47257265 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357011:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e800 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445986.357017:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d47257265 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357030:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d47257265 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357187:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d47257265 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357197:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000055ac770/0xc1b37c4d47257265 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789445986.357232:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.357241:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007db7d32/0xc1b37c4d47257281 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357244:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789445986.357255:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000857f7bac/0xc1b37c4d4725726c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.357260:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=424s v=(0 0) 00010000:00010000:3.0:1789445986.357279:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445986.357281:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445986.357288:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000857f7bac/0xc1b37c4d4725726c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.357293:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007db7d32/0xc1b37c4d47257281 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.357310:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007db7d32/0xc1b37c4d47257281 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357319:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000857f7bac/0xc1b37c4d4725726c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.357326:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007db7d32/0xc1b37c4d47257281 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357340:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000857f7bac/0xc1b37c4d4725726c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.357342:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007db7d32/0xc1b37c4d47257281 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357375:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000857f7bac/0xc1b37c4d4725726c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.357382:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789445986.357392:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789445986.357398:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eeae283/0xc1b37c4d47257273 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357405:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e200 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445986.357408:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eeae283/0xc1b37c4d47257273 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357429:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eeae283/0xc1b37c4d47257273 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357588:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eeae283/0xc1b37c4d47257273 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357598:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eeae283/0xc1b37c4d47257273 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357614:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789445986.357618:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000096313b1/0xc1b37c4d4725727a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357625:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6fa00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445986.357628:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000096313b1/0xc1b37c4d4725727a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357636:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000096313b1/0xc1b37c4d4725727a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357644:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000096313b1/0xc1b37c4d4725727a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357652:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000096313b1/0xc1b37c4d4725727a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357681:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789445986.357685:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007db7d32/0xc1b37c4d47257281 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357692:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6e600 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445986.357696:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007db7d32/0xc1b37c4d47257281 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357703:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007db7d32/0xc1b37c4d47257281 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357718:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007db7d32/0xc1b37c4d47257281 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357726:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007db7d32/0xc1b37c4d47257281 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.357744:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445986.357746:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445986.357748:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445986.357824:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789445986.357856:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.357865:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47257288 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.357875:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.357894:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.357900:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47257288 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.357923:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47257288 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.357934:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47257288 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.357941:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47257288 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.357969:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789445986.358103:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789445986.358110:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47257288 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.358120:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6ec00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445986.358131:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47257288 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.358141:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47257288 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.358155:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47257288 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.358164:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032f8e303/0xc1b37c4d47257288 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.358191:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445986.358193:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445986.358195:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789445986.358617:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.358625:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ac56e8a/0xc1b37c4d4725728f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.358635:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.358638:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.358642:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ac56e8a/0xc1b37c4d4725728f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.358650:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ac56e8a/0xc1b37c4d4725728f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.358658:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ac56e8a/0xc1b37c4d4725728f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.358676:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ac56e8a/0xc1b37c4d4725728f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.358698:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789445986.358714:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789445986.358720:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ac56e8a/0xc1b37c4d4725728f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.358728:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6f400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445986.358732:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ac56e8a/0xc1b37c4d4725728f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.358742:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ac56e8a/0xc1b37c4d4725728f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.358760:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ac56e8a/0xc1b37c4d4725728f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.358767:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ac56e8a/0xc1b37c4d4725728f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.358790:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445986.358792:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445986.358794:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789445986.359807:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.359823:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d09c8aa4/0xc1b37c4d47257296 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.359834:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.359837:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.359842:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d09c8aa4/0xc1b37c4d47257296 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.359854:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d09c8aa4/0xc1b37c4d47257296 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.359863:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d09c8aa4/0xc1b37c4d47257296 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.359871:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d09c8aa4/0xc1b37c4d47257296 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.359971:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789445986.360252:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445986.360260:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d09c8aa4/0xc1b37c4d47257296 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445986.360268:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6f000 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445986.360273:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d09c8aa4/0xc1b37c4d47257296 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445986.360282:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d09c8aa4/0xc1b37c4d47257296 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445986.360299:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d09c8aa4/0xc1b37c4d47257296 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445986.360320:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d09c8aa4/0xc1b37c4d47257296 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445986.360342:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445986.360344:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445986.360345:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789445986.360834:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.360842:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008c451f5/0xc1b37c4d4725729d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.360852:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.360856:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.360861:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008c451f5/0xc1b37c4d4725729d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.360871:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008c451f5/0xc1b37c4d4725729d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.360896:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008c451f5/0xc1b37c4d4725729d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.360904:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008c451f5/0xc1b37c4d4725729d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.360925:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789445986.361369:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.361375:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baabea4/0xc1b37c4d472572a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.361384:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.361386:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.361390:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001baabea4/0xc1b37c4d472572a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.361399:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001baabea4/0xc1b37c4d472572a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.361406:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001baabea4/0xc1b37c4d472572a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.361414:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001baabea4/0xc1b37c4d472572a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.361442:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789445986.361864:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.361871:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f29997e/0xc1b37c4d472572ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.361893:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.361896:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.361900:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f29997e/0xc1b37c4d472572ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.361909:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f29997e/0xc1b37c4d472572ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.361917:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f29997e/0xc1b37c4d472572ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.361924:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f29997e/0xc1b37c4d472572ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.361933:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1789445986.362359:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.362365:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001773a2d5/0xc1b37c4d472572b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.362373:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.362382:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.362386:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001773a2d5/0xc1b37c4d472572b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.362396:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001773a2d5/0xc1b37c4d472572b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.362405:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001773a2d5/0xc1b37c4d472572b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.362413:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001773a2d5/0xc1b37c4d472572b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.362422:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1789445986.364176:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789445986.364190:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008c451f5/0xc1b37c4d4725729d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364205:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6f600 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445986.364210:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008c451f5/0xc1b37c4d4725729d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364220:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008c451f5/0xc1b37c4d4725729d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364244:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008c451f5/0xc1b37c4d4725729d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364253:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008c451f5/0xc1b37c4d4725729d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364281:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789445986.364285:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001baabea4/0xc1b37c4d472572a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364291:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6ee00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445986.364295:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001baabea4/0xc1b37c4d472572a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364302:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001baabea4/0xc1b37c4d472572a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364333:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001baabea4/0xc1b37c4d472572a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364341:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001baabea4/0xc1b37c4d472572a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364359:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789445986.364363:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f29997e/0xc1b37c4d472572ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364369:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0c00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445986.364373:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f29997e/0xc1b37c4d472572ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364379:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f29997e/0xc1b37c4d472572ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364390:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f29997e/0xc1b37c4d472572ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364397:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f29997e/0xc1b37c4d472572ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364412:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445986.364416:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001773a2d5/0xc1b37c4d472572b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364429:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0e00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445986.364432:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001773a2d5/0xc1b37c4d472572b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364439:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001773a2d5/0xc1b37c4d472572b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364448:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001773a2d5/0xc1b37c4d472572b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364455:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001773a2d5/0xc1b37c4d472572b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.364468:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445986.364469:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445986.364471:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445986.364555:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789445986.370491:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.370504:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9a591f4/0xc1b37c4d472572b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.370518:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.370522:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.370527:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9a591f4/0xc1b37c4d472572b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.370538:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9a591f4/0xc1b37c4d472572b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.370546:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9a591f4/0xc1b37c4d472572b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.370557:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9a591f4/0xc1b37c4d472572b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.370708:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789445986.370756:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445986.370772:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9a591f4/0xc1b37c4d472572b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.370786:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c1a00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445986.370792:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9a591f4/0xc1b37c4d472572b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.370806:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9a591f4/0xc1b37c4d472572b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.370850:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9a591f4/0xc1b37c4d472572b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.370872:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9a591f4/0xc1b37c4d472572b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.370916:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445986.370918:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445986.370920:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789445986.373146:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.373161:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d2440c5/0xc1b37c4d472572c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.373177:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.373181:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.373186:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d2440c5/0xc1b37c4d472572c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.373198:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d2440c5/0xc1b37c4d472572c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.373208:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d2440c5/0xc1b37c4d472572c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.373215:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d2440c5/0xc1b37c4d472572c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.373240:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789445986.373285:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445986.373297:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d2440c5/0xc1b37c4d472572c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.373311:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c1e00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445986.373317:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d2440c5/0xc1b37c4d472572c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.373329:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d2440c5/0xc1b37c4d472572c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.373352:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d2440c5/0xc1b37c4d472572c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.373361:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d2440c5/0xc1b37c4d472572c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.373417:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445986.373420:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445986.373424:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789445986.374413:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.374428:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d472572c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.374456:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.374462:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.374645:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d472572c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.374755:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d472572c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.374771:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d472572c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.374782:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d472572c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.374807:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789445986.374848:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445986.374931:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d472572c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.374943:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0600 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445986.374949:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d472572c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.374961:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d472572c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.374981:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d472572c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.374991:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d472572c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.375024:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445986.375026:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445986.375032:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789445986.375775:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.375784:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023683302/0xc1b37c4d472572ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.375795:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.375799:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.375804:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023683302/0xc1b37c4d472572ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.375814:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023683302/0xc1b37c4d472572ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.375974:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023683302/0xc1b37c4d472572ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.375986:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023683302/0xc1b37c4d472572ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.376145:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789445986.376218:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445986.376229:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023683302/0xc1b37c4d472572ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.376261:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0a00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445986.376266:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023683302/0xc1b37c4d472572ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.376278:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023683302/0xc1b37c4d472572ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.376299:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023683302/0xc1b37c4d472572ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.376307:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023683302/0xc1b37c4d472572ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.376332:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445986.376334:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445986.376336:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789445986.376771:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.376778:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d472572d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.376789:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.376792:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.376797:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d472572d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.376808:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d472572d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.376817:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d472572d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.376824:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d472572d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.377010:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789445986.377085:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445986.377094:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d472572d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.377105:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c1200 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445986.377109:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d472572d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.377120:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d472572d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.377215:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d472572d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.377226:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d472572d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.377253:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445986.377255:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445986.377257:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789445986.377722:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.377730:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b6c1bb/0xc1b37c4d472572dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.377743:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.377747:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.377751:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b6c1bb/0xc1b37c4d472572dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.377762:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b6c1bb/0xc1b37c4d472572dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.377771:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b6c1bb/0xc1b37c4d472572dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.377778:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021b6c1bb/0xc1b37c4d472572dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.377950:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789445986.377953:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445986.377962:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021b6c1bb/0xc1b37c4d472572dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.377973:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c1800 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789445986.377976:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b6c1bb/0xc1b37c4d472572dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.377986:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b6c1bb/0xc1b37c4d472572dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.378000:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021b6c1bb/0xc1b37c4d472572dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.378007:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b6c1bb/0xc1b37c4d472572dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.378042:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445986.378068:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445986.378073:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789445986.378740:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.378749:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000387eac3f/0xc1b37c4d472572e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.378760:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.378770:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.378775:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000387eac3f/0xc1b37c4d472572e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.378788:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000387eac3f/0xc1b37c4d472572e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.378796:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000387eac3f/0xc1b37c4d472572e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.378804:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000387eac3f/0xc1b37c4d472572e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.378964:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789445986.379401:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1789445986.379412:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789445986.379413:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000387eac3f/0xc1b37c4d472572e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.379433:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d472572ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.379438:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0200 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445986.379449:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1789445986.379456:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000387eac3f/0xc1b37c4d472572e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.379457:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.379466:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d472572ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.379502:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000387eac3f/0xc1b37c4d472572e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.379510:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d472572ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.379524:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d472572ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.379525:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000387eac3f/0xc1b37c4d472572e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445986.379549:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000387eac3f/0xc1b37c4d472572e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.379564:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d472572ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.379592:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789445986.379609:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789445986.379690:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445986.379696:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445986.379702:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789445986.380415:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.380425:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d472572f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.380437:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.380441:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.380445:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d472572f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.380456:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d472572f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.380466:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d472572f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.380473:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d472572f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.380559:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789445986.380957:0:15680:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789445986.380963:0:15680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d472572f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.380979:0:15680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0800 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445986.380984:0:15680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d472572f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.380993:0:15680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d472572f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.381010:0:15680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d472572f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.381018:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d472572f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.381081:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d472572ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.381088:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0000 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445986.381092:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d472572ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.381100:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d472572ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.381110:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d472572ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.381130:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d472572ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.381146:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445986.381148:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445986.381209:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445986.381238:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445986.381244:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445986.381246:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445986.381248:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789445986.383327:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.383364:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f3fbff/0xc1b37c4d472572f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.383385:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.383391:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.383399:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f3fbff/0xc1b37c4d472572f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.383417:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2f3fbff/0xc1b37c4d472572f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.383430:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f3fbff/0xc1b37c4d472572f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.383439:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f3fbff/0xc1b37c4d472572f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.383485:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789445986.383505:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789445986.384978:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2f3fbff/0xc1b37c4d472572f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.384991:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c1600 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445986.384996:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f3fbff/0xc1b37c4d472572f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.385007:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f3fbff/0xc1b37c4d472572f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.385029:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2f3fbff/0xc1b37c4d472572f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.385038:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f3fbff/0xc1b37c4d472572f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.385090:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445986.385092:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445986.385094:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789445986.387267:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.387283:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c86ccfb9/0xc1b37c4d472572ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.387302:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.387321:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.387448:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c86ccfb9/0xc1b37c4d472572ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.387472:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c86ccfb9/0xc1b37c4d472572ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.387487:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c86ccfb9/0xc1b37c4d472572ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.387497:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c86ccfb9/0xc1b37c4d472572ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.387793:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789445986.387811:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789445986.387818:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c86ccfb9/0xc1b37c4d472572ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.387827:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c1c00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445986.387831:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c86ccfb9/0xc1b37c4d472572ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.387842:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c86ccfb9/0xc1b37c4d472572ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.387861:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c86ccfb9/0xc1b37c4d472572ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.387892:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c86ccfb9/0xc1b37c4d472572ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.387911:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445986.387913:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445986.387915:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789445986.390781:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.390792:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d47257306 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.390808:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.390812:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.390818:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d47257306 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.390832:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d47257306 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.390842:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d47257306 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.390849:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d47257306 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.390869:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789445986.391462:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.391476:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d4725730d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.391488:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.391492:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.391496:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d4725730d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.391505:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d4725730d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.391528:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d4725730d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.391535:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d4725730d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.391559:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789445986.391928:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789445986.391938:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d47257306 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.391949:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0000 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445986.391953:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d47257306 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.391964:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d47257306 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.391983:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d47257306 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.392000:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372485d0/0xc1b37c4d47257306 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.392018:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1789445986.392019:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789445986.392022:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d4725730d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.392027:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036271035/0xc1b37c4d47257314 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.392034:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0800 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445986.392039:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d4725730d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.392042:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.392073:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789445986.392074:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d4725730d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.392082:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036271035/0xc1b37c4d47257314 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.392091:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d4725730d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.392095:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036271035/0xc1b37c4d47257314 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.392100:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5439287/0xc1b37c4d4725730d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.392126:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036271035/0xc1b37c4d47257314 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.392128:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445986.392131:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445986.392134:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445986.392140:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036271035/0xc1b37c4d47257314 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.392166:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789445986.392194:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789445986.392201:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036271035/0xc1b37c4d47257314 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.392217:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c1000 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445986.392221:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036271035/0xc1b37c4d47257314 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.392228:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036271035/0xc1b37c4d47257314 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.392241:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036271035/0xc1b37c4d47257314 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.392249:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036271035/0xc1b37c4d47257314 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445986.392266:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445986.392268:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445986.392270:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789445986.392648:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789445986.392655:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725731b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.392664:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789445986.392668:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789445986.392671:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725731b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.392680:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725731b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.392688:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725731b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.392694:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725731b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.392720:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789445986.392730:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789445986.392734:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725731b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.392741:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445986.392744:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725731b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.392752:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725731b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.392763:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725731b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.392770:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725731b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445986.392785:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445986.392787:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445986.392789:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789445986.393012:0:15044:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1789445986.393131:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14381:x1876369742067840:12345-0@lo:5:osp-pre-0-0.0 Request processed in 57117us (57746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445986.393141:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789445986.393197:0:14381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14381:1876369742067840:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789445986.393211:0:14381:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1789445986.393251:0:14381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14381:1876369742067968:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789445986.393281:0:14381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445986.393316:0:14381:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789445986.393331:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742067968 00000100:00100000:1.0:1789445986.393336:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742067968 00000100:00100000:1.0:1789445986.393370:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789445986.393377:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14381:x1876369742067968:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789445986.393413:0:15042:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:1.0:1789445986.394125:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789445986.396133:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1789445986.396622:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445986.404952:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14381:x1876369742067968:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11566us (11662us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789445986.404966:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789445986.405001:0:14381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14381:1876369742067968:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789445986.405018:0:14381:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:1.0:1789445987.354198:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789445972/real 1789445972] req@ffff9afeba5cd500 x1876369742062976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789445987 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445987.354487:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afeba5cd500 x1876369742062976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789445987 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789445987.354510:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afebffe2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789445987.354596:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789445987.354601:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742062976:0@lo:8:kworker.0 00000100:00100000:2.0:1789445987.354909:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742068224:0@lo:400:kworker.0 00000100:00100000:2.0:1789445987.354982:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789445987.355075:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789445987.355079:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789445987.355082:0:8:0:(import.c:65:import_set_state_nolock()) ffff9afebffe2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789445987.355086:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 410 00000100:00080000:3.0:1789445987.355091:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789445987.355112:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9afebffe2800 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:3.0:1789445987.355134:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afeadb99500 x1876369742068352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789445987.355240:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c012be7-6701-48ad-95ae-ff4709bfdc58:3311:1876369742068096:0@lo:400:kworker.0 00000100:00100000:0.0:1789445987.355276:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445987.356026:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789445987.356037:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742068480:0@lo:400:kworker.0 00000100:00100000:2.0:1789445987.356092:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445987.356153:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742068224 00000100:00100000:2.0:1789445987.356160:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742068224 00000100:00100000:2.0:1789445987.356205:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789445987.356223:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1876369742068224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789445987.356274:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1876369742068224:12345-0@lo:400:kworker.0 Request processed in 53us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445987.356281:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789445987.356319:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742068224:0@lo:400:kworker.0 00000100:00100000:0.0:1789445987.356503:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742068480 00000100:00100000:0.0:1789445987.356508:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742068480 00000100:00100000:0.0:1789445987.356546:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789445987.356553:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742068480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445987.356599:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742068480:12345-0@lo:400:kworker.0 Request processed in 47us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445987.356605:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789445987.356864:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afeadb9ad80 x1876369742068480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445987.356886:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742068480:0@lo:400:kworker.0 00000100:00100000:3.0:1789445987.357118:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742068096 00000100:00100000:3.0:1789445987.357123:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742068096 00000100:00100000:3.0:1789445987.357150:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789445987.357157:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f97c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:3311:x1876369742068096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445987.357195:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f97c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:3311:x1876369742068096:12345-0@lo:400:kworker.0 Request processed in 39us (1918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445987.357202:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789445987.357300:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742068608:0@lo:400:kworker.0 00000100:00100000:1.0:1789445987.357336:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445987.357575:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742068608 00000100:00100000:3.0:1789445987.357579:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742068608 00000100:00100000:3.0:1789445987.357606:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789445987.357613:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742068608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445987.357910:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876369742068608:12345-0@lo:400:kworker.0 Request processed in 296us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445987.357927:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789445987.357959:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c012be7-6701-48ad-95ae-ff4709bfdc58:3311:1876369742068096:0@lo:400:kworker.0 00000100:00100000:3.0:1789445987.357980:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742068352:0@lo:8:kworker.0 00000100:00100000:3.0:1789445987.358011:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445987.358183:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742068352 00000100:00100000:0.0:1789445987.358188:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742068352 00000100:00100000:0.0:1789445987.358221:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789445987.358225:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876369742068352:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789445987.358241:0:15042:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789445987.358284:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876369742068352:12345-0@lo:8:kworker.0 Request processed in 57us (272us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789445987.358290:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789445987.358577:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afebffe2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789445987.358583:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789445987.358586:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742068352:0@lo:8:kworker.0 00010000:00080000:1.0:1789445987.361068:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afeadb9bb80 x1876369742068608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445987.361465:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876369742068608:0@lo:400:kworker.0 00010000:00010000:1.0:1789445987.420730:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789445987.569329:0:15761:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789445987.569336:0:15761:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789445987.569488:0:15761:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9afe9f932000 00000020:01000004:1.0:1789445987.569510:0:15761:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789445987.569527:0:15761:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789445987.569547:0:15761:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9afeb57c19c0) 00000020:00000080:1.0:1789445987.569573:0:15761:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789445987.584487:0:15761:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789445987.584715:0:15761:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789445987.585523:0:15761:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789445987.585757:0:15761:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789445987.585993:0:15761:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789445987.587361:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 551: rc = 0 00100000:10000000:1.0:1789445987.587460:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 551: rc = 0 00100000:10000000:1.0:1789445987.587560:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 551: rc = 0 00100000:10000000:1.0:1789445987.588112:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 89: rc = 0 00100000:10000000:1.0:1789445987.588348:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 89: rc = 0 00100000:10000000:1.0:1789445987.588576:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 89: rc = 0 00100000:10000000:1.0:1789445987.588808:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 89: rc = 0 00100000:10000000:1.0:1789445987.589170:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 89: rc = 0 00100000:10000000:1.0:1789445987.590286:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 89: rc = 0 00000020:00000080:1.0:1789445987.590920:0:15761:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789445987.590935:0:15761:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789445987.590946:0:15761:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc1b37c4d47257329 00000020:01000004:1.0:1789445987.590963:0:15761:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1789445987.590987:0:15761:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.159@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789445987.590990:0:15761:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789445987.590997:0:15761:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789445987.591021:0:15761:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1789445987.591026:0:15761:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.159@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789445987.598020:0:15761:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.159@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789445987.598096:0:15761:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.159@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789445987.598101:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789445987.598103:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789445987.598105:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789445987.598106:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789445987.598108:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789445987.598109:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789445987.598110:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789445987.598112:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789445987.598113:0:15761:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789445987.598118:0:15761:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789445987.598120:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789445987.598121:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789445987.598123:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789445987.598124:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789445987.598125:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789445987.598126:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789445987.598127:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789445987.598128:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789445987.598129:0:15761:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789445987.598168:0:15761:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789445987.598193:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742068736:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789445987.598276:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445987.598397:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe89df1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789445987.598447:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742068736 00000100:00100000:3.0:1789445987.598456:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742068736 00000100:00100000:3.0:1789445987.598558:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789445987.598568:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f97c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:15761:x1876369742068736:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789445987.598612:0:14350:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789445987.598615:0:14350:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789445987.598619:0:14350:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789445987.608249:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f97c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:15761:x1876369742068736:12345-0@lo:253:mount.lustre.0 Request processed in 9669us (9959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445987.608269:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789445987.608372:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742068736:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789445987.608391:0:15761:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789445987.608394:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789445987.608411:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789445987.608413:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789445987.608414:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789445987.608415:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789445987.608416:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789445987.608418:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789445987.608420:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789445987.608421:0:15761:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789445987.608447:0:15761:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9afe9f932000 from lustre-OST0001 10000000:01000000:1.0:1789445987.608480:0:15761:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789445987.608483:0:15761:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789445987.608493:0:15761:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9afeba508000 local copy 00010000:00010000:1.0:1789445987.608505:0:15761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe91b6ea00/0xc1b37c4d472570cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472570d6 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445987.608915:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742068864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789445987.608963:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445987.609099:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe811ca300 going to sleep for 11 seconds 00000100:00100000:2.0:1789445987.609210:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742068864 00000100:00100000:2.0:1789445987.609218:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742068864 00000100:00100000:2.0:1789445987.609303:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789445987.609314:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f97f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:15761:x1876369742068864:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789445987.609513:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f97f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:15761:x1876369742068864:12345-0@lo:501:mount.lustre.0 Request processed in 200us (549us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789445987.609522:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789445987.609597:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742068864:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789445987.609613:0:15761:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789445987.609757:0:15761:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789445987.609764:0:15761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe91b6ea00/0xc1b37c4d472570cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472570d6 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.609775:0:15761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe91b6ea00/0xc1b37c4d472570cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472570d6 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445987.609802:0:15761:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9afe9f932000 10000000:01000000:1.0:1789445987.609807:0:15761:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789445987.609823:0:15761:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789445987.609826:0:15761:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789445987.609836:0:15761:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789445987.609839:0:15761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789445987.609867:0:15761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afd832c1400/0xc1b37c4d47257330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.609884:0:15761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afd832c1400/0xc1b37c4d47257330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.609895:0:15761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afd832c1400/0xc1b37c4d47257330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445987.609911:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742068992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789445987.609941:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445987.610098:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe811ca300 going to sleep for 11 seconds 00000100:00100000:0.0:1789445987.610266:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742068992 00000100:00100000:0.0:1789445987.610272:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742068992 00000100:00100000:0.0:1789445987.610303:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789445987.610312:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f97ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:15761:x1876369742068992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789445987.610324:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445987.610339:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afea4907c00/0xc1b37c4d47257337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47257330 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445987.610364:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afea4907c00/0xc1b37c4d47257337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47257330 expref: 17 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445987.610389:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afea4907c00/0xc1b37c4d47257337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47257330 expref: 17 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445987.610398:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907c00, rc 0) 00000100:00100000:0.0:1789445987.610435:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f97ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+17:15761:x1876369742068992:12345-0@lo:101:mount.lustre.0 Request processed in 126us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445987.610442:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789445987.610542:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742068992:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789445987.610554:0:15761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afd832c1400/0xc1b37c4d47257330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257337 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.610564:0:15761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afd832c1400/0xc1b37c4d47257330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47257337 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789445987.611384:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789445987.612443:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789445987.613146:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789445987.613201:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789445987.613232:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789445987.613275:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789445987.613309:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789445987.613340:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789445987.613411:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789445987.613430:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789445987.613532:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742069120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789445987.613606:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445987.613650:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe811ca0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445987.613915:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742069120 00000100:00100000:2.0:1789445987.613925:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742069120 00000100:00100000:2.0:1789445987.613985:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789445987.613996:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f97e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+17:15761:x1876369742069120:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789445987.614426:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f97e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+17:15761:x1876369742069120:12345-0@lo:501:mount.lustre.0 Request processed in 432us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445987.614434:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789445987.614657:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742069120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789445987.614775:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742069248:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789445987.614916:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445987.614990:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe811ca0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445987.615066:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742069248 00000100:00100000:3.0:1789445987.615072:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742069248 00000100:00100000:2.0:1789445987.615178:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789445987.615187:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+17:15761:x1876369742069248:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789445987.615561:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+17:15761:x1876369742069248:12345-0@lo:503:mount.lustre.0 Request processed in 374us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445987.615569:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789445987.615702:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742069248:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789445987.616514:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789445987.616616:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742069376:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789445987.616677:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445987.616989:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe811ca0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445987.617174:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742069376 00000100:00100000:0.0:1789445987.617184:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742069376 00000100:00100000:0.0:1789445987.617231:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789445987.617243:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f97f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+17:15761:x1876369742069376:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789445987.617497:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f97f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+17:15761:x1876369742069376:12345-0@lo:502:mount.lustre.0 Request processed in 256us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445987.617505:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789445987.617616:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742069376:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789445987.617917:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789445987.617972:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789445987.618008:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789445987.618098:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789445987.618140:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789445987.618175:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789445987.618222:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789445987.618260:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789445987.618308:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789445987.618348:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742069504:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789445987.618403:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445987.618430:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe811ca0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445987.618610:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742069504 00000100:00100000:0.0:1789445987.618617:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742069504 00000100:00100000:0.0:1789445987.618644:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789445987.618650:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe90ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+17:15761:x1876369742069504:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789445987.618826:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe90ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+17:15761:x1876369742069504:12345-0@lo:502:mount.lustre.0 Request processed in 175us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445987.618833:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789445987.618998:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742069504:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789445987.619101:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789445987.619111:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1789445987.620022:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789445987.620034:0:15762:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789445987.620042:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445987.620079:0:15762:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789445987.620087:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789445987.620106:0:15762:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9afeb57c3380) 00000020:00000080:1.0:1789445987.620133:0:15762:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789445987.620141:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789445987.620229:0:15762:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afe9f932000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789445987.620238:0:15762:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789445987.620246:0:15762:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc1b37c4d47257345 00010000:00010000:1.0:1789445987.625421:0:15762:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1789445987.628302:0:15762:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1789445987.631626:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789445987.633450:0:15762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789445987.633466:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445987.633473:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445987.633475:0:15762:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789445987.633483:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789445987.633487:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445987.633489:0:15762:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789445987.633492:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789445987.633494:0:15762:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789445987.633496:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445987.633498:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445987.633499:0:15762:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789445987.633502:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789445987.633504:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445987.633505:0:15762:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789445987.633509:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789445987.633590:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445987.633594:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445987.633596:0:15762:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789445987.633600:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789445987.637798:0:15761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789445987.637861:0:15761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789445987.637897:0:15761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afd832c1400/0xc1b37c4d47257330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257337 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445987.637911:0:15761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afd832c1400/0xc1b37c4d47257330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257337 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789445987.637932:0:15761:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afe9f932000 from 1 10000000:01000000:2.0:1789445987.637936:0:15761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789445987.637983:0:15761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d4725734c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445987.637992:0:15761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d4725734c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445987.638005:0:15761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d4725734c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445987.638037:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742069632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789445987.638157:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445987.638211:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742069632 00000100:00100000:2.0:1789445987.638220:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742069632 00000100:00100000:2.0:1789445987.638279:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789445987.638289:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+17:15761:x1876369742069632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789445987.638305:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445987.638320:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257353 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d4725734c expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445987.638347:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d4725734c expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445987.638359:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d4725734c expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445987.638369:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57be400, rc 0) 00000100:00100000:2.0:1789445987.638415:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:15761:x1876369742069632:12345-0@lo:101:mount.lustre.0 Request processed in 127us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445987.638423:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789445987.638475:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe82ec80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445987.638503:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742069632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789445987.638520:0:15761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d4725734c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257353 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445987.638529:0:15761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d4725734c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47257353 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789445987.639223:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789445987.639616:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789445987.639885:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789445987.639934:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789445987.640000:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789445987.640009:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789445987.640119:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81216a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742069760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789445987.640186:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445987.640244:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742069760 00000100:00100000:2.0:1789445987.640251:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742069760 00000100:00100000:2.0:1789445987.640289:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789445987.640298:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:15761:x1876369742069760:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789445987.640505:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:15761:x1876369742069760:12345-0@lo:501:mount.lustre.0 Request processed in 206us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445987.640513:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789445987.642242:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe82ec80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445987.642288:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81216a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742069760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789445987.642359:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742069888:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789445987.642443:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445987.642479:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe87dd6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789445987.643215:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742069888 00000100:00100000:2.0:1789445987.643228:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742069888 00000100:00100000:2.0:1789445987.643304:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789445987.643316:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:15761:x1876369742069888:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789445987.643655:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:15761:x1876369742069888:12345-0@lo:503:mount.lustre.0 Request processed in 339us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445987.643662:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789445987.647909:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742069888:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789445987.650503:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789445987.650626:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742070016:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789445987.651114:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445987.651166:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896ab240 going to sleep for 11 seconds 00000100:00100000:2.0:1789445987.651292:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742070016 00000100:00100000:2.0:1789445987.651303:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742070016 00000100:00100000:2.0:1789445987.651361:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789445987.651373:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:15761:x1876369742070016:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789445987.651614:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:15761:x1876369742070016:12345-0@lo:502:mount.lustre.0 Request processed in 244us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445987.651623:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789445987.651887:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742070016:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789445987.652219:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789445987.652278:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789445987.652329:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789445987.652368:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789445987.652402:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789445987.652450:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789445987.652491:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789445987.652525:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1789445987.652566:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742070144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789445987.652626:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445987.652656:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896ab240 going to sleep for 11 seconds 00000100:00100000:2.0:1789445987.652796:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742070144 00000100:00100000:2.0:1789445987.652803:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742070144 00000100:00100000:2.0:1789445987.652859:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789445987.652868:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:15761:x1876369742070144:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789445987.653088:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:15761:x1876369742070144:12345-0@lo:502:mount.lustre.0 Request processed in 219us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445987.653096:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789445987.653279:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742070144:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789445987.653388:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789445987.653399:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789445987.655762:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789445987.655780:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445987.655783:0:15766:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789445987.655795:0:15766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afe9f932000 00000020:00000080:1.0:1789445987.655798:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789445987.655807:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445987.655894:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445987.655895:0:15766:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789445987.655900:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789445987.655903:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445987.655904:0:15766:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789445987.655908:0:15766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afe9f932000 00000020:00000080:1.0:1789445987.655911:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789445987.655980:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445987.655984:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445987.655986:0:15766:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789445987.655989:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789445987.655992:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445987.655993:0:15766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789445987.655997:0:15766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afe9f932000 00000020:00000080:1.0:1789445987.656000:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789445987.656039:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789445987.656081:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789445987.656083:0:15766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789445987.656088:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1789445987.656502:0:15761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789445987.656539:0:15761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789445987.656569:0:15761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d4725734c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257353 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445987.656583:0:15761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d4725734c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257353 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789445987.656632:0:15761:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789445987.656635:0:15761:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9afe9f932000 10000000:01000000:0.0:1789445987.656638:0:15761:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9afe9f932000 10000000:01000000:0.0:1789445987.656656:0:15761:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789445987.656663:0:15761:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afe9f932000 from 1 10000000:01000000:0.0:1789445987.656666:0:15761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789445987.656722:0:15761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afea4907400/0xc1b37c4d4725735a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445987.656731:0:15761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afea4907400/0xc1b37c4d4725735a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445987.656743:0:15761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afea4907400/0xc1b37c4d4725735a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445987.656770:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742070272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789445987.656975:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445987.657033:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742070272 00000100:00100000:0.0:1789445987.657065:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742070272 00000100:00100000:0.0:1789445987.657116:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789445987.657125:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:15761:x1876369742070272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789445987.657141:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445987.657156:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afea4906400/0xc1b37c4d47257361 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d4725735a expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445987.657184:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afea4906400/0xc1b37c4d47257361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d4725735a expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445987.657194:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afea4906400/0xc1b37c4d47257361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d4725735a expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445987.657203:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906400, rc 0) 00000100:00100000:0.0:1789445987.657239:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:15761:x1876369742070272:12345-0@lo:101:mount.lustre.0 Request processed in 114us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445987.657255:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789445987.657308:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896aba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789445987.657334:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742070272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789445987.657350:0:15761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afea4907400/0xc1b37c4d4725735a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257361 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445987.657360:0:15761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afea4907400/0xc1b37c4d4725735a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d47257361 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789445987.658156:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789445987.661279:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789445987.668146:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789445987.668263:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789445987.668294:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789445987.668330:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789445987.668358:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789445987.668394:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789445987.668420:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789445987.668444:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789445987.668478:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789445987.668503:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789445987.668527:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789445987.668561:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789445987.668586:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789445987.668612:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789445987.668647:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789445987.668715:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789445987.668742:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789445987.668793:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789445987.669710:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789445987.669768:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789445987.669997:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789445987.670037:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789445987.670102:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789445987.670154:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789445987.670192:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789445987.670227:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789445987.670275:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789445987.670312:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789445987.670341:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789445987.670380:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1789445987.670408:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1789445987.670455:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1789445987.670484:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1789445987.670523:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1789445987.670553:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1789445987.670595:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1789445987.670626:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1789445987.670804:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1789445987.670812:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1789445987.671028:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742070400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789445987.671140:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445987.671201:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896ab0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445987.671309:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742070400 00000100:00100000:2.0:1789445987.671319:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742070400 00000100:00100000:2.0:1789445987.671381:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789445987.671393:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:15761:x1876369742070400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789445987.675068:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:15761:x1876369742070400:12345-0@lo:501:mount.lustre.0 Request processed in 3649us (3899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445987.675085:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789445987.675569:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742070400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789445987.675638:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742070528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789445987.675768:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445987.675804:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742070528 00000100:00100000:0.0:1789445987.678800:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742070528 00000100:00100000:0.0:1789445987.678975:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789445987.678988:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:15761:x1876369742070528:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789445987.679310:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:15761:x1876369742070528:12345-0@lo:503:mount.lustre.0 Request processed in 323us (3541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445987.679319:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789445987.679395:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896ab0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445987.679422:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742070528:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789445987.682501:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789445987.682648:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742070656:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789445987.683411:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445987.683497:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896ab0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445987.692858:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742070656 00000100:00100000:3.0:1789445987.692887:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742070656 00000100:00100000:3.0:1789445987.692972:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789445987.692985:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadbaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:15761:x1876369742070656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789445987.693415:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadbaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:15761:x1876369742070656:12345-0@lo:502:mount.lustre.0 Request processed in 431us (10005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445987.693423:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789445987.697247:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742070656:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789445987.697671:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789445987.697826:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789445987.697865:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789445987.697928:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789445987.697985:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789445987.698078:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789445987.698119:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789445987.698154:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789445987.698204:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789445987.698237:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789445987.698270:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789445987.698317:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789445987.698353:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789445987.698387:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789445987.698450:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789445987.698491:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789445987.698523:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789445987.698568:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789445987.698615:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789445987.698648:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789445987.701069:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789445987.701468:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789445987.701500:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789445987.701544:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789445987.701572:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789445987.701597:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789445987.701633:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789445987.701658:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789445987.701683:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789445987.701732:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789445987.701771:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789445987.701805:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789445987.701935:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789445987.701985:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789445987.702020:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789445987.702094:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789445987.702921:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789445987.702974:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789445987.703038:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789445987.703095:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789445987.703179:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742070784:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789445987.703801:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445987.704023:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8513f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789445987.704625:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742070784 00000100:00100000:3.0:1789445987.704637:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742070784 00000100:00100000:3.0:1789445987.704770:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789445987.704783:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:15761:x1876369742070784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789445987.705132:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:15761:x1876369742070784:12345-0@lo:502:mount.lustre.0 Request processed in 351us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445987.705151:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789445987.705208:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742070784:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789445987.705657:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789445987.705676:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789445987.714302:0:15771:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789445987.714346:0:15771:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9afd81114d40) 00000020:00000080:2.0:1789445987.714377:0:15771:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1789445987.714473:0:15771:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afe9f932000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789445987.714478:0:15771:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afe9f932000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789445987.714480:0:15771:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afe9f932000 3 00010000:00080000:2.0:1789445987.714518:0:15771:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afea4a1a000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.159@tcp at head 00010000:00010000:2.0:1789445987.717941:0:15771:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1789445987.718241:0:15771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789445987.718301:0:15771:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789445987.718322:0:15771:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc1b37c4d4725736f 00000100:00080000:2.0:1789445987.718335:0:15771:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789445987.718760:0:15771:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9afea4a1a000 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:2.0:1789445987.719127:0:15771:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afd81214700 x1876369742070912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789445987.719206:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876369742070912:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789445987.719295:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789445987.719366:0:15771:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789445987.720291:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742070912 00000100:00100000:2.0:1789445987.720303:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742070912 00000100:00100000:2.0:1789445987.720356:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789445987.720365:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1876369742070912:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789445987.720398:0:14358:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:2.0:1789445987.720462:0:14358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc1b37c4d47257376 00000004:00100000:2.0:1789445987.720481:0:14358:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789445987.720518:0:14358:0:(import.c:65:import_set_state_nolock()) ffff9afd8251f000 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1789445987.724864:0:15771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1789445987.725415:0:15761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00000100:00100000:2.0:1789445987.725436:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876369742070912:12345-0@lo:38:llog_process_th.0 Request processed in 5063us (6134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445987.725451:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789445987.725563:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afd81214700 x1876369742070912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789445997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789445987.725576:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789445987.725589:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789445987.725600:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789445987.725605:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789445987.725609:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afea4a1a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789445987.725618:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876369742070912:0@lo:38:llog_process_th.0 10000000:01000000:0.0:1789445987.725922:0:15761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789445987.725987:0:15761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afea4907400/0xc1b37c4d4725735a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257361 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445987.725999:0:15761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afea4907400/0xc1b37c4d4725735a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d47257361 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789445987.726333:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789445987.726336:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789445987.726337:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789445987.726338:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789445987.726340:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789445987.726341:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789445987.726343:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789445987.726345:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789445987.726346:0:15761:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789445987.726350:0:15761:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789445987.726353:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789445987.726354:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789445987.726355:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789445987.726356:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789445987.726357:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789445987.726358:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789445987.726359:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789445987.726360:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789445987.726361:0:15761:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789445987.726391:0:15761:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789445987.726412:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742071040:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789445987.726567:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445987.727007:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896ab240 going to sleep for 11 seconds 00000100:00100000:2.0:1789445987.729167:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742071040 00000100:00100000:2.0:1789445987.729186:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742071040 00000100:00100000:2.0:1789445987.729661:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789445987.729676:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:15761:x1876369742071040:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789445987.729908:0:14350:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789445987.729926:0:14350:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789445987.784525:0:14350:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789445987.784597:0:14350:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789445987.784797:0:14374:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789445987.784803:0:14374:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789445987.784907:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afeb57bf400/0xc1b37c4d4725737d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445987.784946:0:14374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d47257250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47257249 expref: 19 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445987.784956:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afeb57bf400/0xc1b37c4d4725737d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445987.785006:0:14374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d47257250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47257249 expref: 19 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445987.785023:0:14374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d47257250 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47257249 expref: 19 pid: 14350 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789445987.785040:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81214a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1876369742071168:0@lo:104: 00000100:00100000:2.0:1789445987.785181:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445987.785281:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8513f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789445987.789038:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742071168 00000100:00100000:0.0:1789445987.789076:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742071168 00000100:00100000:0.0:1789445987.789136:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789445987.789147:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81214380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c012be7-6701-48ad-95ae-ff4709bfdc58+3:14374:x1876369742071168:12345-0@lo:104: 00010000:00010000:0.0:1789445987.789170:0:14340:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe91b6fc00/0xc1b37c4d47257249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47257250 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445987.789295:0:14340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789445987.789302:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81214380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c012be7-6701-48ad-95ae-ff4709bfdc58+3:14374:x1876369742071168:12345-0@lo:104: Request processed in 158us (4121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445987.789310:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789445987.789369:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81214a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1876369742071168:0@lo:104: 00010000:00010000:0.0:1789445987.789399:0:14374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afeb57bf400/0xc1b37c4d4725737d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.790781:0:15680:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789445987.790795:0:15680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe91b6fc00/0xc1b37c4d47257249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47257250 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.790840:0:15680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe91b6fc00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:1.0:1789445987.790844:0:15680:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe91b6fc00/0xc1b37c4d47257249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47257250 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.790855:0:15680:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe91b6fc00/0xc1b37c4d47257249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47257250 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789445987.790862:0:15680:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe91b6fc00/0xc1b37c4d47257249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47257250 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789445987.790867:0:15680:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789445987.790924:0:15680:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe91b6fc00/0xc1b37c4d47257249 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47257250 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.790931:0:15680:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789445987.790954:0:15680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe91b6fc00/0xc1b37c4d47257249 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47257250 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.790961:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe91b6fc00/0xc1b37c4d47257249 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47257250 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.790982:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445987.790984:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789445987.790985:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789445987.790993:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789445987.791013:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c012be7-6701-48ad-95ae-ff4709bfdc58:3310:1876369742071296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789445987.791106:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445987.791178:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742071296 00000100:00100000:1.0:1789445987.791187:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742071296 00010000:00010000:1.0:1789445987.791227:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d47257250 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47257249 expref: 20 pid: 14350 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789445987.791261:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789445987.791270:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c012be7-6701-48ad-95ae-ff4709bfdc58+20:3310:x1876369742071296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789445987.791285:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789445987.791291:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d47257250 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47257249 expref: 20 pid: 14350 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.791303:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d47257250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47257249 expref: 20 pid: 14350 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.791318:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afeb57bf600/0xc1b37c4d47257250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47257249 expref: 20 pid: 14350 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.791334:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afeb57bf400/0xc1b37c4d4725737d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.791344:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afeb57bf400/0xc1b37c4d4725737d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789445987.791361:0:14343:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006559560s 00010000:00010000:1.0:1789445987.791366:0:14343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afeb57bf400/0xc1b37c4d4725737d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.791374:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afeb57bf400/0xc1b37c4d4725737d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.791381:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afeb57bf400/0xc1b37c4d4725737d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.791388:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afeb57bf400/0xc1b37c4d4725737d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.791401:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789445987.791406:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afeb57bf400/0xc1b37c4d4725737d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.791414:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afeb57bf400/0xc1b37c4d4725737d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.791445:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afeb57bf400/0xc1b37c4d4725737d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.791456:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789445987.791495:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:3310:x1876369742071296:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445987.791504:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789445987.791551:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c012be7-6701-48ad-95ae-ff4709bfdc58:3310:1876369742071296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789445987.791575:0:14374:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afeb57bf400/0xc1b37c4d4725737d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.791584:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afeb57bf400/0xc1b37c4d4725737d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445987.791590:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afeb57bf400/0xc1b37c4d4725737d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445987.796962:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:15761:x1876369742071040:12345-0@lo:253:mount.lustre.0 Request processed in 67276us (70381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445987.796979:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789445987.797178:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c012be7-6701-48ad-95ae-ff4709bfdc58:15761:1876369742071040:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789445987.797198:0:15761:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789445987.797202:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789445987.797204:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789445987.797206:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789445987.797207:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789445987.797209:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789445987.797210:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789445987.797212:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789445987.797214:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789445987.797216:0:15761:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789445987.797238:0:15761:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789445987.802214:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789445987.802394:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789445987.802567:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789445987.802783:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789445987.803001:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789445987.803318:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789445987.810581:0:15761:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789445987.934001:0:15761:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789445987.934016:0:15761:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789445987.934090:0:15761:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789445987.934189:0:15761:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.159@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789445987.934217:0:15761:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789445987.934262:0:15761:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789445988.445090:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445989.484682:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789445989.639513:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1789445989.639591:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:3.0:1789445989.786856:0:14354:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789445989.786875:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afeada0c800 from 8 10000000:01000000:3.0:1789445989.786879:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789445989.787648:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257384 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445989.787662:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257384 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445989.787674:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257384 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789445989.787709:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742071424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789445989.787772:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789445989.790610:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe90d1fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789445989.790670:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742071424 00000100:00100000:2.0:1789445989.790680:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742071424 00000100:00100000:2.0:1789445989.790743:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789445989.790753:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:14354:x1876369742071424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789445989.790768:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445989.790785:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afeb57bea00/0xc1b37c4d4725738b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d47257384 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445989.790811:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afeb57bea00/0xc1b37c4d4725738b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d47257384 expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445989.790830:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afeb57bea00/0xc1b37c4d4725738b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47257384 expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445989.790839:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb57bea00, rc 0) 00000100:00100000:2.0:1789445989.790913:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:14354:x1876369742071424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (3141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445989.790920:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789445989.792852:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742071424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789445989.792897:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257384 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725738b expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445989.792909:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257384 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d4725738b expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789445989.792974:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742071552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789445989.793031:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445989.793091:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeadb5fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789445989.793956:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742071552 00000100:00100000:1.0:1789445989.793967:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742071552 00000100:00100000:1.0:1789445989.794731:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789445989.794743:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:14354:x1876369742071552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789445989.794767:0:14350:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789445989.794845:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789445989.794849:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789445989.795743:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:14354:x1876369742071552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1000us (2709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445989.795753:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789445989.795919:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742071552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789445989.796002:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789445989.796012:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257384 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725738b expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445989.796023:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afe8e988e00/0xc1b37c4d47257384 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d4725738b expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445990.499313:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445991.515944:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445991.517406:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789445991.517434:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742071680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789445991.517524:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445991.518395:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742071680 00000100:00100000:2.0:1789445991.518407:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742071680 00000100:00100000:2.0:1789445991.518465:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789445991.518473:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742071680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789445991.518508:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789445991.518563:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742071680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445991.518570:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789445991.520084:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445991.520299:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789445991.520327:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742071680:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789445992.540080:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789445993.050690:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789445993.050700:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789445993.050705:0:38:0:(import.c:65:import_set_state_nolock()) ffff9afebffe2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789445993.050714:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 425 00000100:00080000:1.0:1789445993.050722:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789445993.050736:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9afebffe2800 using connection 192.168.206.159@tcp/0@lo 00000100:00100000:1.0:1789445993.050763:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afebffc2300 x1876369742072064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789445993.050866:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c012be7-6701-48ad-95ae-ff4709bfdc58:3313:1876369742071808:0@lo:400:kworker.0 00000100:00100000:1.0:1789445993.050957:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445993.051028:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742072448:0@lo:400:kworker.0 00000100:00100000:1.0:1789445993.051084:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445993.051115:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789445993.051121:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369742072320:0@lo:400:kworker.0 00000100:00100000:1.0:1789445993.051144:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445993.051176:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742071936:0@lo:400:kworker.0 00000100:00100000:1.0:1789445993.051202:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445993.051221:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789445993.051226:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742072192:0@lo:400:kworker.0 00000100:00100000:1.0:1789445993.051248:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445993.051612:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742072064:0@lo:8:kworker.0 00000100:00100000:1.0:1789445993.051677:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789445993.051718:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742071808 00000100:00100000:1.0:1789445993.051728:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742071808 00000100:00100000:1.0:1789445993.051785:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789445993.051796:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:3313:x1876369742071808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445993.051870:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:3313:x1876369742071808:12345-0@lo:400:kworker.0 Request processed in 75us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445993.051877:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789445993.051923:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742072448 00000100:00100000:1.0:1789445993.051927:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742072448 00000100:00100000:1.0:1789445993.051963:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742072320 00000100:00100000:1.0:1789445993.051966:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742072320 00000100:00100000:1.0:1789445993.051992:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742072192 00000100:00100000:1.0:1789445993.051995:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742072192 00000100:00100000:1.0:1789445993.052147:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789445993.052154:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742072448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445993.052191:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742072448:12345-0@lo:400:kworker.0 Request processed in 37us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445993.052198:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789445993.052212:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789445993.052218:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369742072320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445993.052243:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369742072320:12345-0@lo:400:kworker.0 Request processed in 27us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445993.052248:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789445993.052258:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789445993.052264:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742072192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445993.052297:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742072192:12345-0@lo:400:kworker.0 Request processed in 33us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445993.052303:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789445993.052327:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742071936 00000100:00100000:1.0:1789445993.052331:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742071936 00000100:00100000:1.0:1789445993.052361:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742072064 00000100:00100000:1.0:1789445993.052364:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742072064 00000100:00100000:1.0:1789445993.052374:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789445993.052379:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742071936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789445993.052408:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742071936:12345-0@lo:400:kworker.0 Request processed in 29us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445993.052414:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789445993.052425:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789445993.052437:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3309:x1876369742072064:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789445993.052466:0:15044:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 431 last 0 00000020:00000080:1.0:1789445993.052736:0:15044:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1b37c4d47257392 00002000:00100000:1.0:1789445993.052755:0:15044:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9afeb5c8c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789445993.052760:0:15044:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789445993.052764:0:15044:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789445993.053920:0:15044:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789445993.053963:0:15044:0:(import.c:65:import_set_state_nolock()) ffff9afeb5c8e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789445993.054291:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876369742072064:12345-0@lo:8:kworker.0 Request processed in 1851us (2611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445993.054302:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789445993.054348:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789445993.054354:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789445993.054396:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebffc2a00 x1876369742072192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445993.054413:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742072192:0@lo:400:kworker.0 00000100:00100000:1.0:1789445993.054429:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742071936:0@lo:400:kworker.0 00010000:00080000:1.0:1789445993.054473:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebffc0000 x1876369742072320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445993.054495:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369742072320:0@lo:400:kworker.0 00000100:00100000:1.0:1789445993.054575:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c012be7-6701-48ad-95ae-ff4709bfdc58:3313:1876369742071808:0@lo:400:kworker.0 00010000:00080000:1.0:1789445993.054589:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebffc0a80 x1876369742072448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789445993.054598:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742072448:0@lo:400:kworker.0 00010000:00080000:0.0:1789445993.056279:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afebffc2300 x1876369742072064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789446018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445993.056295:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789445993.056307:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789445993.056318:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789445993.056326:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789445993.056330:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9afebffe2800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789445993.056352:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789445993.056360:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876369742072064:0@lo:8:kworker.0 00000004:00080000:1.0:1789445993.056601:0:14382:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789445993.057268:0:14382:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 431079221540ns, next at 0ns, rc = 0 00000004:00080000:2.0:1789445993.057451:0:14383:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789445993.057487:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81217100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14383:1876369742072704:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789445993.057631:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445993.057672:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeadb80840 going to sleep for 11 seconds 00000100:00100000:2.0:1789445993.057689:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789445993.057698:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742072576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789445993.057722:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445993.057746:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742072576 00000100:00100000:2.0:1789445993.057754:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742072576 00000100:00100000:2.0:1789445993.057809:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789445993.057819:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81214700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876369742072576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789445993.057863:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789445993.057905:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81214700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876369742072576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445993.057913:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789445993.057951:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afd81215500 x1876369742072576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789446009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789445993.057969:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742072576:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789445993.057985:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789445993.058139:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742072704 00000100:00100000:2.0:1789445993.058143:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742072704 00000100:00100000:2.0:1789445993.058166:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789445993.058172:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14383:x1876369742072704:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789445993.084387:0:15044:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789445993.084402:0:15044:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789445993.084410:0:15044:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1789445993.107429:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.107444:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d47257399 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.107475:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.107480:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.107488:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d47257399 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.107646:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d47257399 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.107720:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d47257399 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.107729:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d47257399 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.107756:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789445993.107771:0:15680:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445993.107777:0:15680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d47257399 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.107784:0:15680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bee00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.107789:0:15680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d47257399 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.107799:0:15680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d47257399 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.107831:0:15680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d47257399 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.107839:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d47257399 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.107879:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.107882:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.107883:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789445993.113226:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.113242:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.113262:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.113267:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.113274:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.113291:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.113303:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.113311:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.113354:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789445993.113374:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445993.113381:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.113389:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be800 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.113394:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.113404:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.113423:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.113431:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.113452:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.113454:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.113456:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789445993.119908:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.119925:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.119946:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.119962:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.119970:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.119987:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.121624:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.121646:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.124429:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789445993.124458:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445993.124468:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.125748:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.125756:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.125770:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.125795:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.125817:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.127652:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.127659:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.127662:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789445993.131204:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.131226:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.131246:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.131251:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.131259:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.131277:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.131289:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.131297:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.131321:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789445993.131338:0:15680:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445993.131357:0:15680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.131365:0:15680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bee00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.131371:0:15680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.131381:0:15680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.131401:0:15680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.131409:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.131432:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.131434:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.131436:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789445993.136324:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1789445993.137318:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.137337:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.137363:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.137368:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.137376:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.137411:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.137425:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.137434:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.137455:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789445993.137471:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445993.137478:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.137487:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be800 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.137492:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.139323:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.139371:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.139380:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.139418:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.139420:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.139423:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789445993.145991:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.146614:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.146636:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.146641:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.146650:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.146845:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.146868:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.146878:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.146945:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789445993.154406:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789445993.154424:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.154441:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bee00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445993.154446:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.154459:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.154510:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.154518:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074a5aca9/0xc1b37c4d472573bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.154679:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445993.154681:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445993.154683:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789445993.155949:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789445993.155961:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472573c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445993.155978:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1789445993.155984:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445993.155991:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472573c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445993.156027:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472573c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445993.156039:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472573c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445993.156074:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472573c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445993.156099:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789445993.156777:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789445993.156786:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d472573ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445993.156799:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1789445993.156803:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789445993.156808:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d472573ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445993.156818:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d472573ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445993.156828:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d472573ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445993.156858:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d472573ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445993.156878:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789445993.160433:0:15680:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789445993.160452:0:15680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472573c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.162645:0:15680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907200 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.162660:0:15680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472573c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.162675:0:15680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472573c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.162700:0:15680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472573c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.162708:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fe3dc32/0xc1b37c4d472573c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.162733:0:15680:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445993.162738:0:15680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d472573ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.162745:0:15680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906e00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.162748:0:15680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d472573ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.162755:0:15680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d472573ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.162765:0:15680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d472573ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.162783:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013941116/0xc1b37c4d472573ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.162796:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.162798:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.162800:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.162808:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789445993.162976:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.162985:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.163784:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.163793:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.163803:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.163819:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.163831:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.163840:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.163901:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789445993.164370:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789445993.164379:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.164389:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be800 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445993.164393:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.164404:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.164421:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.164429:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009abc87d1/0xc1b37c4d472573d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.164452:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445993.164454:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445993.164455:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789445993.167289:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.167304:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.167326:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.167331:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.167338:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.167352:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.167364:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.167372:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.167393:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789445993.167409:0:15680:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445993.167415:0:15680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.167422:0:15680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.167428:0:15680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.167454:0:15680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.167473:0:15680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.167494:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058b5345f/0xc1b37c4d472573d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.167521:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.167523:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.167526:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789445993.167998:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.168006:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000927244c6/0xc1b37c4d472573df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.168016:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.168020:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.168025:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000927244c6/0xc1b37c4d472573df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.168035:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000927244c6/0xc1b37c4d472573df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.168074:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000927244c6/0xc1b37c4d472573df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.168088:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000927244c6/0xc1b37c4d472573df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.168104:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789445993.168114:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445993.168119:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000927244c6/0xc1b37c4d472573df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.168127:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bf600 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.168131:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000927244c6/0xc1b37c4d472573df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.168139:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000927244c6/0xc1b37c4d472573df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.168153:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000927244c6/0xc1b37c4d472573df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.168159:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000927244c6/0xc1b37c4d472573df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.168172:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.168174:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.168176:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789445993.172129:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.172155:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f6541d0/0xc1b37c4d472573e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.172177:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.172183:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.172190:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f6541d0/0xc1b37c4d472573e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.172207:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f6541d0/0xc1b37c4d472573e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.172218:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f6541d0/0xc1b37c4d472573e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.172225:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f6541d0/0xc1b37c4d472573e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.172252:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789445993.173172:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.173182:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d472573ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.173195:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.173199:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.173203:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d472573ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.173214:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d472573ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.173243:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d472573ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.173251:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d472573ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.173270:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789445993.173285:0:15680:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789445993.173291:0:15680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f6541d0/0xc1b37c4d472573e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.173299:0:15680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f5c00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.173304:0:15680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f6541d0/0xc1b37c4d472573e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.173313:0:15680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f6541d0/0xc1b37c4d472573e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.173333:0:15680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f6541d0/0xc1b37c4d472573e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.173340:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f6541d0/0xc1b37c4d472573e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.173361:0:15680:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445993.173371:0:15680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d472573ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.173378:0:15680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f5000 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.173381:0:15680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d472573ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.173388:0:15680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d472573ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.173397:0:15680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d472573ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.173404:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d472573ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.173415:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.173417:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.173419:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.173425:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789445993.174743:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.174757:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d472573f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.174773:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.174776:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.174782:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d472573f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.174808:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d472573f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.174819:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d472573f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.174826:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d472573f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.174861:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789445993.174882:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445993.174888:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d472573f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.174895:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f4400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.174899:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d472573f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.174907:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d472573f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.174923:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d472573f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.174930:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d472573f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.174955:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.174958:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.174960:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789445993.179446:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.179465:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ef096e3/0xc1b37c4d472573fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.179497:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.179602:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.179610:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ef096e3/0xc1b37c4d472573fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.179629:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ef096e3/0xc1b37c4d472573fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.179641:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ef096e3/0xc1b37c4d472573fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.179649:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ef096e3/0xc1b37c4d472573fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.179742:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789445993.180405:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.180412:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257402 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.180439:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.180443:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.180448:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.180459:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.180468:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.180475:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.180741:0:15680:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789445993.180750:0:15680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ef096e3/0xc1b37c4d472573fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.180770:0:15680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f5400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445993.180781:0:15680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ef096e3/0xc1b37c4d472573fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.180792:0:15680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ef096e3/0xc1b37c4d472573fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.180813:0:15680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ef096e3/0xc1b37c4d472573fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.180821:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ef096e3/0xc1b37c4d472573fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.180868:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789445993.180880:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445993.180885:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.180893:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f4c00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.180896:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.180904:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257402 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.180925:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257402 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.180932:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257402 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.180954:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.180956:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.180958:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789445993.182861:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.182877:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d47257409 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.182893:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.182898:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.182905:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d47257409 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.182920:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d47257409 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.182931:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d47257409 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.182939:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d47257409 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.182971:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789445993.182986:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445993.182992:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d47257409 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.183736:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f4e00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.183742:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d47257409 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.183753:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d47257409 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.183775:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d47257409 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.183782:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d47257409 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.183808:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.183810:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.183812:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445993.184747:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445993.184749:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445993.184751:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789445993.187883:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.187897:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d47257410 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.187917:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.187928:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.187935:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d47257410 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.187950:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d47257410 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.187962:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d47257410 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.187970:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d47257410 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.187995:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789445993.188095:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445993.188101:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d47257410 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.188110:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f5a00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.188114:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d47257410 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.188126:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d47257410 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.188145:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d47257410 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.188165:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d47257410 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.188185:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.188187:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.188189:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789445993.188973:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.188982:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257417 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.188995:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.190657:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.190679:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.190703:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.190716:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.190724:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257417 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.190781:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789445993.190799:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445993.190814:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257417 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.190824:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f5e00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.190829:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257417 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.190840:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257417 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.190872:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257417 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.190881:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257417 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.190911:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.190913:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.190915:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789445993.194408:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.194424:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b3f4612/0xc1b37c4d4725741e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.194446:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.194452:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.194460:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b3f4612/0xc1b37c4d4725741e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.194888:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b3f4612/0xc1b37c4d4725741e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.194906:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b3f4612/0xc1b37c4d4725741e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.194915:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b3f4612/0xc1b37c4d4725741e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.194986:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789445993.195637:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.195645:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f1360e/0xc1b37c4d47257425 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.195659:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.195663:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.195668:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f1360e/0xc1b37c4d47257425 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.195679:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7f1360e/0xc1b37c4d47257425 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.195687:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f1360e/0xc1b37c4d47257425 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.195708:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f1360e/0xc1b37c4d47257425 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.200237:0:15680:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789445993.200256:0:15680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b3f4612/0xc1b37c4d4725741e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.200272:0:15680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f4600 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445993.200278:0:15680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b3f4612/0xc1b37c4d4725741e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.200291:0:15680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b3f4612/0xc1b37c4d4725741e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.200343:0:15680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b3f4612/0xc1b37c4d4725741e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.200352:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b3f4612/0xc1b37c4d4725741e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.200388:0:15680:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789445993.200392:0:15680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7f1360e/0xc1b37c4d47257425 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.200400:0:15680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f4a00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445993.200403:0:15680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f1360e/0xc1b37c4d47257425 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.200410:0:15680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f1360e/0xc1b37c4d47257425 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.200419:0:15680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7f1360e/0xc1b37c4d47257425 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.200426:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445993.200428:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445993.200430:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.201387:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789445993.201399:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7f1360e/0xc1b37c4d47257425 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1789445993.201441:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1789445993.202350:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.202361:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d4725742c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.202377:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.202382:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.202390:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d4725742c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.202405:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d4725742c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.202417:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d4725742c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.202426:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d4725742c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.207696:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789445993.207715:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d4725742c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.207760:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f5a00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445993.207766:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d4725742c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.207780:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d4725742c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.207806:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d4725742c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.207819:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445993.207821:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445993.207823:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.208831:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789445993.208844:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004006a1d6/0xc1b37c4d4725742c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789445993.209771:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.209781:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257433 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.209797:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.209802:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.209810:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257433 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.209827:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257433 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.209838:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257433 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.209856:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257433 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.214639:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789445993.214659:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257433 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.214675:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f5e00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445993.214681:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257433 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.214694:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257433 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.214722:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257433 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.214746:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445993.214748:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445993.214750:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.214820:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789445993.214830:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064d5c88f/0xc1b37c4d47257433 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.215087:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789445993.216164:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.216176:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d4725743a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.216194:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.216200:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.216207:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d4725743a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.216221:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d4725743a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.216233:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d4725743a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.216241:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d4725743a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.216264:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789445993.216828:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.216835:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257441 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.216845:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.216861:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.216872:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.216883:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.216893:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.216901:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257441 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.216914:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789445993.217380:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.217386:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d47257448 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217395:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.217399:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.217403:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d47257448 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217412:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d47257448 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217420:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d47257448 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217439:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d47257448 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217459:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789445993.217475:0:15680:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789445993.217482:0:15680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d4725743a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217489:0:15680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f4e00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.217494:0:15680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d4725743a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217684:0:15680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d4725743a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217708:0:15680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d4725743a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217716:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee9790fb/0xc1b37c4d4725743a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217738:0:15680:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789445993.217742:0:15680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257441 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217760:0:15680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f4c00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.217764:0:15680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257441 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217772:0:15680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257441 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217783:0:15680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257441 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217791:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056b6019f/0xc1b37c4d47257441 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217805:0:15680:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789445993.217808:0:15680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d47257448 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217815:0:15680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f4400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789445993.217818:0:15680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d47257448 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217826:0:15680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d47257448 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217837:0:15680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d47257448 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217862:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f286b9c4/0xc1b37c4d47257448 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.217877:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.217879:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445993.217881:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445993.218427:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445993.218435:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789445993.218673:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789445993.218680:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d4725744f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.218692:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1789445993.218696:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789445993.218702:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d4725744f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.218713:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d4725744f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.218722:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d4725744f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.218729:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d4725744f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445993.218951:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789445993.219253:0:15044:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1789445993.219372:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14383:x1876369742072704:12345-0@lo:5:osp-pre-1-0.0 Request processed in 161194us (161736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445993.219383:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789445993.219453:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81217100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14383:1876369742072704:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789445993.219471:0:14383:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789445993.219611:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81217100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14383:1876369742072832:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789445993.219652:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445993.219698:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afead822000 going to sleep for 11 seconds 00000100:00100000:2.0:1789445993.219718:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742072832 00000100:00100000:2.0:1789445993.219726:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742072832 00000100:00100000:2.0:1789445993.219784:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789445993.219795:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81215500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14383:x1876369742072832:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789445993.219843:0:15043:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1789445993.223290:0:15680:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789445993.223306:0:15680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d4725744f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.223322:0:15680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f5000 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789445993.223329:0:15680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d4725744f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.223341:0:15680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d4725744f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.223366:0:15680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d4725744f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.223375:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000378e799d/0xc1b37c4d4725744f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445993.223403:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445993.223405:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789445993.223407:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445993.229875:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81215500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14383:x1876369742072832:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10073us (10213us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789445993.229892:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789445993.230386:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81217100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14383:1876369742072832:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789445993.230407:0:14383:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1789445993.562225:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789445994.586356:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789445994.845548:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1789445995.415388:0:16120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg659-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789445995.610781:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445996.634342:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789445996.634394:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742072960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789445996.634462:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445996.634573:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742072960 00000100:00100000:2.0:1789445996.634581:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742072960 00000100:00080000:3.0:1789445996.634722:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789445996.634819:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789445996.634840:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742072960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789445996.634874:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789445996.634926:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742072960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445996.634933:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789445996.635097:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742072960:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789445997.669388:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789445997.872800:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445997.872892:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722154368 00000100:00100000:3.0:1789445997.872904:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722154368 00000100:00100000:3.0:1789445997.872951:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 78 00000100:00100000:3.0:1789445997.872958:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2373:x1876369722154368:12345-192.168.206.59@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789445997.872983:0:14350:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 0da5c432-b9e3-4d15-b46a-529046cbdbfd@192.168.206.59@tcp t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:3.0:1789445997.873009:0:14350:0:(genops.c:1384:class_connect()) connect: client 0da5c432-b9e3-4d15-b46a-529046cbdbfd, cookie 0xc1b37c4d47257456 00000100:00080000:3.0:1789445997.873180:0:14350:0:(import.c:65:import_set_state_nolock()) ffff9afebfa4b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789445997.873255:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+5:2373:x1876369722154368:12345-192.168.206.59@tcp:250:mount.lustre.0 Request processed in 295us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445997.873264:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 78 00000100:00100000:3.0:1789445997.891270:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445997.891752:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722154496 00000100:00100000:1.0:1789445997.891762:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722154496 00000100:00100000:1.0:1789445997.891838:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 79 00000100:00100000:1.0:1789445997.891848:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+5:13776:x1876369722154496:12345-192.168.206.59@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789445997.891864:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789445997.891881:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd832c0a00/0xc1b37c4d4725745d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ee1 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445997.891907:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd832c0a00/0xc1b37c4d4725745d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ee1 expref: 6 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445997.891918:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd832c0a00/0xc1b37c4d4725745d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ee1 expref: 6 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789445997.891926:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd832c0a00, rc 0) 00000100:00100000:1.0:1789445997.891988:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+6:13776:x1876369722154496:12345-192.168.206.59@tcp:101:mount.lustre.0 Request processed in 141us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445997.891995:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 79 00000100:00100000:2.0:1789445997.904880:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445997.905025:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722154624 00000100:00100000:0.0:1789445997.905035:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722154624 00000100:00100000:0.0:1789445997.905116:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 80 00000100:00100000:0.0:1789445997.905127:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+6:13776:x1876369722154624:12345-192.168.206.59@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789445997.905474:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+6:13776:x1876369722154624:12345-192.168.206.59@tcp:501:mount.lustre.0 Request processed in 348us (600us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789445997.905482:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 80 00000100:00100000:0.0:1789445997.907430:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445997.907510:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722154752 00000100:00100000:3.0:1789445997.907518:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722154752 00000100:00100000:3.0:1789445997.907563:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 81 00000100:00100000:3.0:1789445997.907571:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+6:13776:x1876369722154752:12345-192.168.206.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789445997.907586:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789445997.907601:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe8e989800/0xc1b37c4d47257464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ee8 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445997.907649:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe8e989800/0xc1b37c4d47257464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ee8 expref: 7 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445997.907662:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe8e989800/0xc1b37c4d47257464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ee8 expref: 7 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789445997.907671:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989800, rc 0) 00000100:00100000:3.0:1789445997.907720:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+7:13776:x1876369722154752:12345-192.168.206.59@tcp:101:mount.lustre.0 Request processed in 150us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445997.907727:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 81 00000100:00100000:3.0:1789445997.914158:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445997.914336:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722154880 00000100:00100000:1.0:1789445997.914345:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722154880 00000100:00100000:1.0:1789445997.914396:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 82 00000100:00100000:1.0:1789445997.914406:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+7:13776:x1876369722154880:12345-192.168.206.59@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789445997.914688:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+8:13776:x1876369722154880:12345-192.168.206.59@tcp:501:mount.lustre.0 Request processed in 282us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445997.914696:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 82 00000100:00100000:2.0:1789445997.921833:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445997.921987:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722155008 00000100:00100000:0.0:1789445997.921996:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722155008 00000100:00100000:0.0:1789445997.922071:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 83 00000100:00100000:0.0:1789445997.922082:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+8:13776:x1876369722155008:12345-192.168.206.59@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789445997.922415:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+8:13776:x1876369722155008:12345-192.168.206.59@tcp:503:mount.lustre.0 Request processed in 334us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445997.922424:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 83 00000100:00100000:0.0:1789445997.932676:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445997.934265:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722155136 00000100:00100000:3.0:1789445997.934278:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722155136 00000100:00100000:3.0:1789445997.934341:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 84 00000100:00100000:3.0:1789445997.934351:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+8:13794:x1876369722155136:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789445997.934998:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+8:13794:x1876369722155136:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 646us (2328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445997.935007:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 84 00000100:00100000:3.0:1789445997.972902:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445997.973187:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722155264 00000100:00100000:1.0:1789445997.973195:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722155264 00000100:00100000:1.0:1789445997.973244:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 85 00000100:00100000:1.0:1789445997.973254:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+8:13794:x1876369722155264:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789445997.974684:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+8:13794:x1876369722155264:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 1424us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789445997.974703:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 85 00000100:00100000:2.0:1789445997.994121:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445997.994214:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722155392 00000100:00100000:0.0:1789445997.994223:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722155392 00000100:00100000:0.0:1789445997.994276:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 86 00000100:00100000:0.0:1789445997.994286:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f07f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+8:13776:x1876369722155392:12345-192.168.206.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789445997.994301:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445997.994316:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afea4907600/0xc1b37c4d4725746b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4f12 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445997.994343:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afea4907600/0xc1b37c4d4725746b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f12 expref: 9 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445997.994367:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afea4907600/0xc1b37c4d4725746b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f12 expref: 9 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445997.994375:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907600, rc 0) 00000100:00100000:0.0:1789445997.994437:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f07f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+9:13776:x1876369722155392:12345-192.168.206.59@tcp:101:mount.lustre.0 Request processed in 153us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445997.994444:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 86 00000100:00100000:0.0:1789445998.004607:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445998.005879:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722155520 00000100:00100000:1.0:1789445998.005891:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722155520 00000100:00100000:1.0:1789445998.005953:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 87 00000100:00100000:1.0:1789445998.005963:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe97068450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+9:13776:x1876369722155520:12345-192.168.206.59@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789445998.005988:0:14352:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789445998.006012:0:14352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789445998.006017:0:14352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789445998.006020:0:14352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789445998.006022:0:14352:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789445998.012497:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe97068450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+9:13776:x1876369722155520:12345-192.168.206.59@tcp:256:mount.lustre.0 Request processed in 6525us (7889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445998.012511:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 87 00000100:00100000:2.0:1789445998.022475:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445998.025408:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722155648 00000100:00100000:3.0:1789445998.025455:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722155648 00000100:00100000:2.0:1789445998.025895:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 88 00000100:00100000:2.0:1789445998.025907:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9706a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+9:13776:x1876369722155648:12345-192.168.206.59@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789445998.025924:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789445998.025940:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afeba8f4800/0xc1b37c4d47257472 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4f19 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445998.025968:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afeba8f4800/0xc1b37c4d47257472 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f19 expref: 10 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445998.025979:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afeba8f4800/0xc1b37c4d47257472 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f19 expref: 10 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789445998.025987:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeba8f4800, rc 0) 00000100:00100000:2.0:1789445998.026183:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9706a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+10:13776:x1876369722155648:12345-192.168.206.59@tcp:101:mount.lustre.0 Request processed in 277us (3714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445998.026191:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 88 00000100:00100000:0.0:1789445998.044958:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445998.046353:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722155776 00000100:00100000:3.0:1789445998.046365:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722155776 00000100:00100000:3.0:1789445998.046439:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 89 00000100:00100000:3.0:1789445998.046449:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+10:13776:x1876369722155776:12345-192.168.206.59@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789445998.046740:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+10:13776:x1876369722155776:12345-192.168.206.59@tcp:501:mount.lustre.0 Request processed in 292us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445998.046748:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 89 00000100:00100000:1.0:1789445998.051337:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445998.051440:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722155904 00000100:00100000:2.0:1789445998.051448:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722155904 00000100:00100000:2.0:1789445998.051499:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 90 00000100:00100000:2.0:1789445998.051516:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+10:13776:x1876369722155904:12345-192.168.206.59@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789445998.051966:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+10:13776:x1876369722155904:12345-192.168.206.59@tcp:503:mount.lustre.0 Request processed in 457us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445998.051974:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 90 00000100:00100000:2.0:1789445998.067489:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445998.069038:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722156032 00000100:00100000:0.0:1789445998.069074:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722156032 00000100:00100000:0.0:1789445998.069136:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 91 00000100:00100000:0.0:1789445998.069145:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+10:13797:x1876369722156032:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789445998.069617:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+10:13797:x1876369722156032:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 471us (2135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445998.069626:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 91 00000100:00100000:0.0:1789445998.089151:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445998.089235:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722156160 00000100:00100000:3.0:1789445998.089245:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722156160 00000100:00100000:3.0:1789445998.089348:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 92 00000100:00100000:3.0:1789445998.089358:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+10:13797:x1876369722156160:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789445998.089615:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+10:13797:x1876369722156160:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 257us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445998.089623:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 92 00000100:00100000:1.0:1789445998.096653:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445998.096874:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722156288 00000100:00100000:3.0:1789445998.096883:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722156288 00000100:00100000:3.0:1789445998.096926:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 4 00000100:00100000:3.0:1789445998.096933:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2373:x1876369722156288:12345-192.168.206.59@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789445998.096960:0:14357:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from cd59ee15-eef8-4c7f-9b3c-4edbf6ead749@192.168.206.59@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:3.0:1789445998.097007:0:14357:0:(genops.c:1384:class_connect()) connect: client cd59ee15-eef8-4c7f-9b3c-4edbf6ead749, cookie 0xc1b37c4d47257479 00000004:00100000:3.0:1789445998.097035:0:14357:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789445998.097040:0:14357:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1789445998.136621:0:14357:0:(import.c:65:import_set_state_nolock()) ffff9afe892eb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789445998.137027:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+6:2373:x1876369722156288:12345-192.168.206.59@tcp:38:mount.lustre.0 Request processed in 40090us (40380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445998.137038:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 4 00000100:00100000:1.0:1789445998.147954:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445998.147998:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789445998.148097:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722156544 00000100:00100000:2.0:1789445998.148107:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722156544 00000100:00100000:2.0:1789445998.148218:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722156416 00000100:00100000:2.0:1789445998.148221:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722156416 00000100:00080000:0.0:1789445998.148275:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789445998.149663:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 5 00000100:00100000:0.0:1789445998.151063:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+7:13776:x1876369722156544:12345-192.168.206.59@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789445998.151110:0:14357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789445998.151197:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+7:13776:x1876369722156544:12345-192.168.206.59@tcp:41:mount.lustre.0 Request processed in 1523us (3251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445998.151206:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 5 00000100:00100000:0.0:1789445998.151238:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00100000:0.0:1789445998.151246:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+6:0:x1876369722156416:12345-192.168.206.59@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789445998.151257:0:14357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789445998.151779:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+6:0:x1876369722156416:12345-192.168.206.59@tcp:41:mount.lustre.0 Request processed in 34us (3280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445998.151788:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00100000:0.0:1789445998.154135:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789445998.154283:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722156672 00000100:00100000:3.0:1789445998.154306:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722156672 00000100:00100000:3.0:1789445998.154360:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:3.0:1789445998.154371:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+6:13776:x1876369722156672:12345-192.168.206.59@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789445998.155508:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+6:13776:x1876369722156672:12345-192.168.206.59@tcp:40:mount.lustre.0 Request processed in 1037us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445998.155520:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:1.0:1789445998.159988:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445998.160033:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789445998.160088:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445998.160122:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722156800 00000100:00100000:0.0:1789445998.160132:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722156800 00000100:00100000:0.0:1789445998.160172:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722156928 00000100:00100000:0.0:1789445998.160175:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722156928 00000100:00100000:0.0:1789445998.160189:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:0.0:1789445998.160196:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2373:x1876369722156800:12345-192.168.206.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789445998.160225:0:15042:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from cd59ee15-eef8-4c7f-9b3c-4edbf6ead749@192.168.206.59@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:0.0:1789445998.160254:0:15042:0:(genops.c:1384:class_connect()) connect: client cd59ee15-eef8-4c7f-9b3c-4edbf6ead749, cookie 0xc1b37c4d47257480 00002000:00100000:0.0:1789445998.160265:0:15042:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cd59ee15-eef8-4c7f-9b3c-4edbf6ead749/ffff9afeb57d3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789445998.160290:0:15042:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789445998.160394:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722157056 00000100:00100000:2.0:1789445998.160398:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722157056 00000100:00100000:2.0:1789445998.160571:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 0 00000100:00100000:2.0:1789445998.160579:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+6:13776:x1876369722157056:12345-192.168.206.59@tcp:33:mount.lustre.0 00002000:00080000:0.0:1789445998.160602:0:15042:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789445998.160641:0:15042:0:(import.c:65:import_set_state_nolock()) ffff9afeb57d0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789445998.160696:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+6:2373:x1876369722156800:12345-192.168.206.59@tcp:8:mount.lustre.0 Request processed in 499us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445998.160704:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:0.0:1789445998.160721:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 8 00000100:00100000:0.0:1789445998.160725:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2373:x1876369722156928:12345-192.168.206.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789445998.160740:0:15042:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from cd59ee15-eef8-4c7f-9b3c-4edbf6ead749@192.168.206.59@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:0.0:1789445998.160758:0:15042:0:(genops.c:1384:class_connect()) connect: client cd59ee15-eef8-4c7f-9b3c-4edbf6ead749, cookie 0xc1b37c4d47257487 00002000:00100000:0.0:1789445998.160763:0:15042:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cd59ee15-eef8-4c7f-9b3c-4edbf6ead749/ffff9afeb57d4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789445998.160776:0:15042:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789445998.160906:0:15042:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789445998.160923:0:15042:0:(import.c:65:import_set_state_nolock()) ffff9afeb57d1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789445998.160945:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+6:2373:x1876369722156928:12345-192.168.206.59@tcp:8:mount.lustre.0 Request processed in 218us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445998.160952:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 8 00000004:00080000:0.0:1789445998.169319:0:14360:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8502us 00000100:00100000:0.0:1789445998.170249:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789445998.170268:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742073088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789445998.170330:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789445998.170361:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742073088 00000100:00100000:2.0:1789445998.170369:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742073088 00000100:00100000:2.0:1789445998.170431:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789445998.170440:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876369742073088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789445998.170461:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789445998.170505:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876369742073088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789445998.170512:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789445998.170533:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789445998.170566:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742073088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789445998.172991:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742073344:0@lo:400:kworker.0 00000100:00100000:0.0:1789445998.173081:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445998.173118:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789445998.173124:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742073472:0@lo:400:kworker.0 00000100:00100000:0.0:1789445998.173150:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445998.173175:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742073600:0@lo:400:kworker.0 00000100:00100000:0.0:1789445998.173209:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445998.173229:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789445998.173235:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c012be7-6701-48ad-95ae-ff4709bfdc58:3312:1876369742073216:0@lo:400:kworker.0 00000100:00100000:0.0:1789445998.173264:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445998.173288:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742073728:0@lo:400:kworker.0 00000100:00100000:0.0:1789445998.173312:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789445998.173339:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742073472 00000100:00100000:0.0:1789445998.173346:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742073472 00000100:00100000:0.0:1789445998.173377:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742073600 00000100:00100000:0.0:1789445998.173379:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742073600 00000100:00100000:0.0:1789445998.173405:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742073728 00000100:00100000:0.0:1789445998.173408:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742073728 00000100:00080000:2.0:1789445998.173409:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789445998.173423:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789445998.173431:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742073472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445998.173477:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876369742073472:12345-0@lo:400:kworker.0 Request processed in 47us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445998.173483:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789445998.173500:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789445998.173506:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742073600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445998.173536:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742073600:12345-0@lo:400:kworker.0 Request processed in 31us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445998.173542:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789445998.173554:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789445998.173560:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742073728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445998.173588:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876369742073728:12345-0@lo:400:kworker.0 Request processed in 28us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445998.173604:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1789445998.173639:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeba5cd500 x1876369742073728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445998.173653:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876369742073728:0@lo:400:kworker.0 00010000:00080000:0.0:1789445998.173664:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeba5cca80 x1876369742073600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445998.173671:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742073600:0@lo:400:kworker.0 00010000:00080000:0.0:1789445998.173699:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afeba5cf800 x1876369742073472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789445998.173708:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876369742073472:0@lo:400:kworker.0 00000100:00100000:0.0:1789445998.173727:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742073216 00000100:00100000:0.0:1789445998.173730:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742073216 00000100:00100000:0.0:1789445998.173755:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789445998.173762:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:3312:x1876369742073216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789445998.173796:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:3312:x1876369742073216:12345-0@lo:400:kworker.0 Request processed in 34us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445998.173802:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789445998.173847:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c012be7-6701-48ad-95ae-ff4709bfdc58:3312:1876369742073216:0@lo:400:kworker.0 00000100:00100000:3.0:1789445998.173964:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742073344 00000100:00100000:3.0:1789445998.173970:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742073344 00000100:00100000:3.0:1789445998.174003:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789445998.174011:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742073344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789445998.174069:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742073344:12345-0@lo:400:kworker.0 Request processed in 59us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445998.174074:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789445998.174289:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789445998.174538:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742073344:0@lo:400:kworker.0 00000004:00200000:3.0:1789445998.199732:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789445998.199858:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+6:13776:x1876369722157056:12345-192.168.206.59@tcp:33:mount.lustre.0 Request processed in 39275us (39874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789445998.199874:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 0 00000001:00100000:1.0:1789445998.263524:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cd59ee15-eef8-4c7f-9b3c-4edbf6ead749 00000001:00080000:1.0:1789445998.263590:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:1.0:1789445998.383615:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789445998.383731:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722157184 00000100:00100000:0.0:1789445998.383740:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722157184 00000100:00100000:0.0:1789445998.383801:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 8 00000100:00100000:0.0:1789445998.383812:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+6:13818:x1876369722157184:12345-192.168.206.59@tcp:101:mkdir.0 00010000:00010000:0.0:1789445998.383843:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789445998.383875:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d4725748e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4f43 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445998.383940:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47257495 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445998.383953:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47257495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445998.383967:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47257495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789445998.384000:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789445998.384004:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789445998.384042:0:14358:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47257495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445998.384109:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906a00/0xc1b37c4d4725748e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f43 expref: 8 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445998.384126:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47257495 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f43 expref: 7 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789445998.384134:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961b00) 00010000:00010000:0.0:1789445998.384137:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789445998.384141:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906c00, rc 0) 00000100:00100000:0.0:1789445998.384193:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+7:13818:x1876369722157184:12345-192.168.206.59@tcp:101:mkdir.0 Request processed in 383us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789445998.384200:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 8 00010000:00010000:0.0:1789445998.684579:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789445999.707650:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789445999.773292:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cd59ee15-eef8-4c7f-9b3c-4edbf6ead749 00000100:00100000:1.0:1789446000.059975:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446000.060079:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722157312 00000100:00100000:3.0:1789446000.060088:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722157312 00000100:00100000:3.0:1789446000.060162:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00100000:3.0:1789446000.060173:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+7:13870:x1876369722157312:12345-192.168.206.59@tcp:41:lfs.0 00000004:00000024:3.0:1789446000.060211:0:14357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789446000.060296:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+7:13870:x1876369722157312:12345-192.168.206.59@tcp:41:lfs.0 Request processed in 126us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446000.060318:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00080000:2.0:1789446000.060557:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789446000.062573:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446000.062657:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722157440 00000100:00100000:2.0:1789446000.062665:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722157440 00000100:00100000:2.0:1789446000.062736:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 5 00000100:00100000:2.0:1789446000.062747:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+5:13870:x1876369722157440:12345-192.168.206.59@tcp:13:lfs.0 00002000:00000024:2.0:1789446000.062780:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789446000.062876:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+5:13870:x1876369722157440:12345-192.168.206.59@tcp:13:lfs.0 Request processed in 130us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446000.062883:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 5 00000100:00080000:0.0:1789446000.062946:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789446000.067965:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446000.068123:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722157568 00000100:00100000:2.0:1789446000.068132:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722157568 00000100:00100000:2.0:1789446000.068199:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00100000:2.0:1789446000.068210:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+5:13870:x1876369722157568:12345-192.168.206.59@tcp:13:lfs.0 00002000:00000024:2.0:1789446000.068248:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789446000.068329:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+5:13870:x1876369722157568:12345-192.168.206.59@tcp:13:lfs.0 Request processed in 121us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446000.068336:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00080000:0.0:1789446000.068405:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789446000.184345:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446000.184427:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722157696 00000100:00100000:3.0:1789446000.184440:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722157696 00000100:00100000:3.0:1789446000.184499:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 94 00000100:00100000:3.0:1789446000.184510:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+10:13902:x1876369722157696:12345-192.168.206.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789446000.184528:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446000.184546:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe8e989000/0xc1b37c4d4725749c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4f4a expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446000.184577:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe8e989000/0xc1b37c4d4725749c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f4a expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446000.184588:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe8e989000/0xc1b37c4d4725749c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f4a expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446000.184597:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989000, rc 0) 00000100:00100000:3.0:1789446000.184666:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+11:13902:x1876369722157696:12345-192.168.206.59@tcp:101:mount.lustre.0 Request processed in 158us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446000.184674:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 94 00000100:00100000:1.0:1789446000.189598:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446000.194109:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722157824 00000100:00100000:2.0:1789446000.194125:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722157824 00000100:00100000:2.0:1789446000.194193:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 95 00000100:00100000:2.0:1789446000.194204:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+11:13902:x1876369722157824:12345-192.168.206.59@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789446000.194519:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+11:13902:x1876369722157824:12345-192.168.206.59@tcp:501:mount.lustre.0 Request processed in 316us (4931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446000.194528:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 95 00000100:00100000:1.0:1789446000.195983:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446000.200660:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722157952 00000100:00100000:0.0:1789446000.200675:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722157952 00000100:00100000:0.0:1789446000.200741:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 96 00000100:00100000:0.0:1789446000.200752:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+11:13902:x1876369722157952:12345-192.168.206.59@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789446000.201029:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+11:13902:x1876369722157952:12345-192.168.206.59@tcp:503:mount.lustre.0 Request processed in 278us (5051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446000.201037:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 96 00000100:00100000:1.0:1789446000.205582:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446000.207990:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722158080 00000100:00100000:2.0:1789446000.208006:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722158080 00000100:00100000:2.0:1789446000.208121:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 97 00000100:00100000:2.0:1789446000.208132:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+11:13909:x1876369722158080:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789446000.208461:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+11:13909:x1876369722158080:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 330us (2892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446000.208470:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 97 00000100:00100000:1.0:1789446000.224412:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446000.226579:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722158208 00000100:00100000:0.0:1789446000.226601:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722158208 00000100:00100000:0.0:1789446000.226763:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 98 00000100:00100000:0.0:1789446000.226776:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+11:13909:x1876369722158208:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789446000.227179:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+11:13909:x1876369722158208:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 404us (2783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446000.227189:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 98 00000100:00100000:1.0:1789446000.229710:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446000.230104:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722158336 00000100:00100000:2.0:1789446000.230117:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722158336 00000100:00100000:2.0:1789446000.230196:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 99 00000100:00100000:2.0:1789446000.230208:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+11:13902:x1876369722158336:12345-192.168.206.59@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789446000.230230:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446000.230253:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afeba8f4200/0xc1b37c4d472574a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4f74 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446000.230288:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afeba8f4200/0xc1b37c4d472574a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f74 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446000.230301:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afeba8f4200/0xc1b37c4d472574a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f74 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446000.230311:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeba8f4200, rc 0) 00000100:00100000:2.0:1789446000.230382:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+12:13902:x1876369722158336:12345-192.168.206.59@tcp:101:mount.lustre.0 Request processed in 176us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446000.230390:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 99 00000100:00100000:1.0:1789446000.232990:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446000.233130:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722158464 00000100:00100000:0.0:1789446000.233142:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722158464 00000100:00100000:0.0:1789446000.233265:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 100 00000100:00100000:0.0:1789446000.233276:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+12:13902:x1876369722158464:12345-192.168.206.59@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789446000.233309:0:14351:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789446000.233340:0:14351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789446000.233345:0:14351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789446000.233348:0:14351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789446000.233350:0:14351:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789446000.235105:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+12:13902:x1876369722158464:12345-192.168.206.59@tcp:256:mount.lustre.0 Request processed in 1820us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446000.235128:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 100 00000100:00100000:1.0:1789446000.238111:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446000.240950:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722158592 00000100:00100000:3.0:1789446000.240976:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722158592 00000100:00100000:3.0:1789446000.241109:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 101 00000100:00100000:3.0:1789446000.241122:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+12:13902:x1876369722158592:12345-192.168.206.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789446000.241147:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446000.241175:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d472574aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4f7b expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446000.241243:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d472574aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f7b expref: 13 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446000.241257:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d472574aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f7b expref: 13 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446000.241269:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989a00, rc 0) 00000100:00100000:3.0:1789446000.241354:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:13902:x1876369722158592:12345-192.168.206.59@tcp:101:mount.lustre.0 Request processed in 234us (3258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446000.241361:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 101 00000100:00100000:1.0:1789446000.243909:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446000.244004:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722158720 00000100:00100000:0.0:1789446000.244016:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722158720 00000100:00100000:0.0:1789446000.244111:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 102 00000100:00100000:0.0:1789446000.244124:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:13902:x1876369722158720:12345-192.168.206.59@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789446000.244557:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:13902:x1876369722158720:12345-192.168.206.59@tcp:501:mount.lustre.0 Request processed in 434us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446000.244593:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 102 00000100:00100000:1.0:1789446000.246735:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446000.246961:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722158848 00000100:00100000:0.0:1789446000.246972:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722158848 00000100:00100000:0.0:1789446000.247035:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 103 00000100:00100000:0.0:1789446000.247081:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb4ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:13902:x1876369722158848:12345-192.168.206.59@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789446000.247732:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb4ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:13902:x1876369722158848:12345-192.168.206.59@tcp:503:mount.lustre.0 Request processed in 685us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446000.247742:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 103 00000100:00100000:1.0:1789446000.251392:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446000.251482:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722158976 00000100:00100000:3.0:1789446000.251494:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722158976 00000100:00100000:3.0:1789446000.251589:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 104 00000100:00100000:3.0:1789446000.251609:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe89960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:13912:x1876369722158976:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789446000.252000:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe89960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:13912:x1876369722158976:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 394us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446000.252010:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 104 00000100:00100000:1.0:1789446000.253973:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446000.254070:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722159104 00000100:00100000:0.0:1789446000.254081:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722159104 00000100:00100000:0.0:1789446000.254138:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 105 00000100:00100000:0.0:1789446000.254160:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe89960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:13912:x1876369722159104:12345-192.168.206.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789446000.254430:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe89960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:13912:x1876369722159104:12345-192.168.206.59@tcp:502:llog_process_th.0 Request processed in 282us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446000.254436:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 105 00000100:00100000:1.0:1789446000.258713:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446000.261340:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722159232 00000100:00100000:3.0:1789446000.261360:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722159232 00000100:00100000:3.0:1789446000.261497:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:3.0:1789446000.261508:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2373:x1876369722159232:12345-192.168.206.59@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789446000.261546:0:14359:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 5773df71-2069-48bb-a13d-12dd45acbeba@192.168.206.59@tcp t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:3.0:1789446000.261594:0:14359:0:(genops.c:1384:class_connect()) connect: client 5773df71-2069-48bb-a13d-12dd45acbeba, cookie 0xc1b37c4d472574b1 00000004:00100000:3.0:1789446000.261633:0:14359:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789446000.261791:0:14359:0:(import.c:65:import_set_state_nolock()) ffff9afeada93000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789446000.261923:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5773df71-2069-48bb-a13d-12dd45acbeba+6:2373:x1876369722159232:12345-192.168.206.59@tcp:38:mount.lustre.0 Request processed in 414us (3224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446000.261930:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:1.0:1789446000.268611:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446000.268887:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446000.269590:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722159488 00000100:00100000:0.0:1789446000.269604:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722159488 00000100:00100000:0.0:1789446000.269710:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722159360 00000100:00100000:0.0:1789446000.269713:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722159360 00000100:00100000:0.0:1789446000.269732:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00100000:0.0:1789446000.269743:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5773df71-2069-48bb-a13d-12dd45acbeba+7:13902:x1876369722159488:12345-192.168.206.59@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789446000.269782:0:14358:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789446000.269876:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5773df71-2069-48bb-a13d-12dd45acbeba+7:13902:x1876369722159488:12345-192.168.206.59@tcp:41:mount.lustre.0 Request processed in 134us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446000.269884:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00100000:0.0:1789446000.269904:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 12 00000100:00100000:0.0:1789446000.269911:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5773df71-2069-48bb-a13d-12dd45acbeba+6:0:x1876369722159360:12345-192.168.206.59@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789446000.269923:0:14358:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789446000.269946:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5773df71-2069-48bb-a13d-12dd45acbeba+6:0:x1876369722159360:12345-192.168.206.59@tcp:41:mount.lustre.0 Request processed in 36us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446000.269953:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 12 00000100:00080000:2.0:1789446000.270155:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789446000.271358:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446000.271511:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722159616 00000100:00100000:0.0:1789446000.271520:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722159616 00000100:00100000:0.0:1789446000.271897:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 13 00000100:00100000:0.0:1789446000.271910:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5773df71-2069-48bb-a13d-12dd45acbeba+6:13902:x1876369722159616:12345-192.168.206.59@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789446000.272005:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5773df71-2069-48bb-a13d-12dd45acbeba+6:13902:x1876369722159616:12345-192.168.206.59@tcp:40:mount.lustre.0 Request processed in 99us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446000.272014:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 13 00000100:00100000:0.0:1789446000.275593:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446000.275687:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446000.275720:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446000.275782:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722160000 00000100:00100000:3.0:1789446000.275794:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722160000 00000100:00100000:3.0:1789446000.275868:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 1 00000100:00100000:3.0:1789446000.275881:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5773df71-2069-48bb-a13d-12dd45acbeba+6:13902:x1876369722160000:12345-192.168.206.59@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789446000.275990:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789446000.276100:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5773df71-2069-48bb-a13d-12dd45acbeba+6:13902:x1876369722160000:12345-192.168.206.59@tcp:33:mount.lustre.0 Request processed in 222us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446000.276108:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 1 00000100:00100000:1.0:1789446000.276568:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722159744 00000100:00100000:1.0:1789446000.276575:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722159744 00000100:00100000:1.0:1789446000.276617:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722159872 00000100:00100000:1.0:1789446000.276621:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722159872 00000100:00100000:1.0:1789446000.276634:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00100000:1.0:1789446000.276640:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2373:x1876369722159744:12345-192.168.206.59@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789446000.276668:0:15044:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 5773df71-2069-48bb-a13d-12dd45acbeba@192.168.206.59@tcp t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:1.0:1789446000.276704:0:15044:0:(genops.c:1384:class_connect()) connect: client 5773df71-2069-48bb-a13d-12dd45acbeba, cookie 0xc1b37c4d472574b8 00002000:00100000:1.0:1789446000.276717:0:15044:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5773df71-2069-48bb-a13d-12dd45acbeba/ffff9afeb5c8d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789446000.276753:0:15044:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789446000.277199:0:15044:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789446000.277235:0:15044:0:(import.c:65:import_set_state_nolock()) ffff9afeb5c8b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789446000.277298:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5773df71-2069-48bb-a13d-12dd45acbeba+6:2373:x1876369722159744:12345-192.168.206.59@tcp:8:mount.lustre.0 Request processed in 656us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446000.277306:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00100000:1.0:1789446000.277326:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:1.0:1789446000.277331:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2373:x1876369722159872:12345-192.168.206.59@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789446000.277351:0:15044:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 5773df71-2069-48bb-a13d-12dd45acbeba@192.168.206.59@tcp t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:1.0:1789446000.277370:0:15044:0:(genops.c:1384:class_connect()) connect: client 5773df71-2069-48bb-a13d-12dd45acbeba, cookie 0xc1b37c4d472574bf 00002000:00100000:1.0:1789446000.277376:0:15044:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5773df71-2069-48bb-a13d-12dd45acbeba/ffff9afebf6af000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789446000.277383:0:15044:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789446000.278422:0:15044:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789446000.278464:0:15044:0:(import.c:65:import_set_state_nolock()) ffff9afebf6a9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789446000.278523:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5773df71-2069-48bb-a13d-12dd45acbeba+6:2373:x1876369722159872:12345-192.168.206.59@tcp:8:mount.lustre.0 Request processed in 1189us (2801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446000.278534:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:0.0:1789446000.412757:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446000.412878:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722160128 00000100:00100000:3.0:1789446000.412897:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722160128 00000100:00100000:3.0:1789446000.413042:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 14 00000100:00100000:3.0:1789446000.413113:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5773df71-2069-48bb-a13d-12dd45acbeba+6:13933:x1876369722160128:12345-192.168.206.59@tcp:101:mkdir.0 00010000:00010000:3.0:1789446000.413145:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446000.413182:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988600/0xc1b37c4d472574c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4fa5 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446000.413279:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d472574cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446000.413296:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d472574cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446000.413313:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d472574cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789446000.413358:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789446000.413381:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789446000.413409:0:14357:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d472574cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446000.413440:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988600/0xc1b37c4d472574c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fa5 expref: 8 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446000.413461:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d472574cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fa5 expref: 7 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446000.413470:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961b00) 00010000:00010000:3.0:1789446000.413473:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789446000.413477:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989c00, rc 0) 00000100:00100000:3.0:1789446000.415023:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5773df71-2069-48bb-a13d-12dd45acbeba+7:13933:x1876369722160128:12345-192.168.206.59@tcp:101:mkdir.0 Request processed in 1909us (2278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446000.415034:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 14 00010000:00010000:0.0:1789446000.730755:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789446001.754410:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789446001.754438:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742073856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789446001.754521:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446001.755187:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742073856 00000100:00100000:2.0:1789446001.755200:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742073856 00000100:00100000:2.0:1789446001.755360:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789446001.755371:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742073856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789446001.755470:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789446001.755533:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742073856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446001.755540:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789446001.755604:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789446001.755778:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446001.755828:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742073856:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789446002.780219:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789446003.058981:0:16322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789446003.292542:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789446003.292569:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742073984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789446003.292634:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446003.293119:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789446003.293133:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c012be7-6701-48ad-95ae-ff4709bfdc58:3313:1876369742074112:0@lo:400:kworker.0 00000100:00100000:3.0:1789446003.293177:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446003.293251:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742074240:0@lo:400:kworker.0 00000100:00100000:3.0:1789446003.293275:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446003.293289:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789446003.293294:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742074624:0@lo:400:kworker.0 00000100:00100000:3.0:1789446003.293317:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446003.293808:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876369742074496:0@lo:400:kworker.0 00000100:00100000:2.0:1789446003.293841:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446003.293871:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789446003.293877:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876369742074368:0@lo:400:kworker.0 00000100:00100000:2.0:1789446003.293896:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446003.293931:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742073984 00000100:00100000:2.0:1789446003.293941:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742073984 00000100:00100000:2.0:1789446003.293993:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789446003.294001:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742073984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789446003.294031:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789446003.294089:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742073984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446003.294096:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789446003.294118:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742074112 00000100:00100000:2.0:1789446003.294122:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742074112 00000100:00100000:2.0:1789446003.294144:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789446003.294150:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe89961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:3313:x1876369742074112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446003.294185:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe89961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:3313:x1876369742074112:12345-0@lo:400:kworker.0 Request processed in 35us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446003.294191:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1789446003.294525:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789446003.294568:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c012be7-6701-48ad-95ae-ff4709bfdc58:3313:1876369742074112:0@lo:400:kworker.0 00000100:00100000:3.0:1789446003.296225:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742074624 00000100:00100000:3.0:1789446003.296245:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742074624 00000100:00100000:3.0:1789446003.296307:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742074496 00000100:00100000:3.0:1789446003.296311:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742074496 00000100:00100000:3.0:1789446003.296327:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742074368 00000100:00100000:3.0:1789446003.296330:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742074368 00000100:00100000:3.0:1789446003.296346:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789446003.296355:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742074624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446003.296443:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876369742074624:12345-0@lo:400:kworker.0 Request processed in 89us (3124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446003.296450:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789446003.296467:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789446003.296473:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876369742074496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446003.296505:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876369742074496:12345-0@lo:400:kworker.0 Request processed in 33us (2664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446003.296511:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789446003.296521:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789446003.296527:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876369742074368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446003.296552:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876369742074368:12345-0@lo:400:kworker.0 Request processed in 26us (2655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446003.296558:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789446003.296603:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876369742074624:0@lo:400:kworker.0 00000100:00100000:3.0:1789446003.296633:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876369742074368:0@lo:400:kworker.0 00000100:00100000:3.0:1789446003.296643:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876369742074496:0@lo:400:kworker.0 00000100:00100000:0.0:1789446003.297011:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742074240 00000100:00100000:0.0:1789446003.297017:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742074240 00000100:00100000:0.0:1789446003.297094:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789446003.297102:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742074240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446003.297153:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742074240:12345-0@lo:400:kworker.0 Request processed in 52us (3877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446003.297160:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789446003.297560:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742074240:0@lo:400:kworker.0 00000100:00100000:0.0:1789446003.297588:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789446003.297607:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742073984:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789446003.299775:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789446003.299792:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1789446003.361977:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5773df71-2069-48bb-a13d-12dd45acbeba 00000001:00100000:2.0:1789446003.361994:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cd59ee15-eef8-4c7f-9b3c-4edbf6ead749 00000001:00100000:2.0:1789446003.369972:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5773df71-2069-48bb-a13d-12dd45acbeba 00010000:00010000:0.0:1789446003.803684:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789446004.058769:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789446004.828252:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789446004.878176:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5773df71-2069-48bb-a13d-12dd45acbeba 00000100:00100000:2.0:1789446005.285462:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446005.285519:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446005.285548:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446005.285576:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722160384 00000100:00100000:1.0:1789446005.285577:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722160640 00000100:00100000:2.0:1789446005.285592:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446005.285592:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722160640 00000100:00100000:0.0:1789446005.285595:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722160384 00000100:00100000:2.0:1789446005.285624:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446005.285651:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446005.285686:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446005.285699:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722160768 00000100:00100000:0.0:1789446005.285706:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722160768 00000100:00100000:2.0:1789446005.285713:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722160256 00000100:00100000:2.0:1789446005.285722:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722160256 00000100:00100000:0.0:1789446005.285752:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 20 00000100:00100000:2.0:1789446005.285773:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 107 00000100:00100000:0.0:1789446005.285784:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+6:2376:x1876369722160384:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789446005.285799:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722160896 00000100:00100000:2.0:1789446005.285805:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe89962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:2376:x1876369722160256:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789446005.285806:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722160896 00000100:00100000:1.0:1789446005.285850:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722160512 00000100:00100000:1.0:1789446005.285855:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722160512 00000100:00100000:1.0:1789446005.285887:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722161024 00000100:00100000:2.0:1789446005.285916:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe89962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:2376:x1876369722160256:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 132us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446005.285929:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+6:2376:x1876369722160384:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 161us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446005.285934:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 107 00000100:00100000:0.0:1789446005.285949:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 20 00000100:00100000:0.0:1789446005.285981:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 21 00000100:00100000:0.0:1789446005.285995:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5773df71-2069-48bb-a13d-12dd45acbeba+6:2376:x1876369722160768:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789446005.286004:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 4 00000100:00100000:2.0:1789446005.286023:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+5:2376:x1876369722160640:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789446005.286107:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722161024 00000100:00100000:2.0:1789446005.286115:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+5:2376:x1876369722160640:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 99us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446005.286127:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 4 00000100:00100000:0.0:1789446005.286128:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5773df71-2069-48bb-a13d-12dd45acbeba+6:2376:x1876369722160768:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 134us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446005.286141:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 21 00000100:00100000:2.0:1789446005.286159:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 5 00000100:00100000:1.0:1789446005.286178:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00100000:2.0:1789446005.286182:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5773df71-2069-48bb-a13d-12dd45acbeba+5:2376:x1876369722160896:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789446005.286186:0:15042:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789446005.286196:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+5:2376:x1876369722160512:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:0.0:1789446005.286203:0:15042:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789446005.286227:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5773df71-2069-48bb-a13d-12dd45acbeba+5:2376:x1876369722160896:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 50us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446005.286240:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 5 00000100:00080000:0.0:1789446005.286243:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789446005.286253:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789446005.286261:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+5:2376:x1876369722160512:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 67us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446005.286262:0:15043:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00080000:0.0:1789446005.286263:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789446005.286282:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00100000:2.0:1789446005.286291:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:2.0:1789446005.286302:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5773df71-2069-48bb-a13d-12dd45acbeba+5:2376:x1876369722161024:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789446005.286340:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5773df71-2069-48bb-a13d-12dd45acbeba+5:2376:x1876369722161024:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 37us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446005.286347:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 7 00010000:00010000:2.0:1789446005.850155:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789446006.211985:0:16474:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff88b31870 20000000:00000080:3.0:1789446006.212007:0:16474:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9afd828c2c00 uarg=0000000000000000 20000000:01000000:3.0:1789446006.212468:0:16474:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789446006.212475:0:16474:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789446006.212480:0:16474:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789446006.213357:0:16475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1789446006.218150:0:16474:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789446006.228685:0:16474:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789446006.228853:0:16474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afea4907200/0xc1b37c4d472574d4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.228872:0:16474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afeb57be600/0xc1b37c4d472571cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472571c4 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.228881:0:16474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe91b6fe00/0xc1b37c4d47257218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d47257211 expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.228887:0:16474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d4725734c expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.228897:0:16474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afeba8f4800/0xc1b37c4d47257472 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f19 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.228906:0:16474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d472574aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f7b expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.228912:0:16474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afea4907200/0xc1b37c4d472574d4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.228961:0:16474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d472574aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f7b expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.228990:0:16474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d472574aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f7b expref: 12 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446006.229006:0:16474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1876369742074752:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789446006.229136:0:16474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afeba8f4800/0xc1b37c4d47257472 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f19 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.229145:0:16474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afeba8f4800/0xc1b37c4d47257472 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f19 expref: 12 pid: 14350 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446006.229153:0:16474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeba5cd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1876369742074880:192.168.206.59@tcp:104: 00010000:00010000:0.0:1789446006.229182:0:16474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d4725734c expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.229190:0:16474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257353 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d4725734c expref: 18 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446006.229198:0:16474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a305f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1876369742075008:0@lo:104: 00000100:00100000:0.0:1789446006.229238:0:16474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789446006.229280:0:16474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afe91b6fe00/0xc1b37c4d47257218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d47257211 expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.229289:0:16474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afe91b6fe00/0xc1b37c4d47257218 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d47257211 expref: 18 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446006.229296:0:16474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a307480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1876369742075136:0@lo:104: 00000100:00100000:0.0:1789446006.229317:0:16474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446006.229367:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742075008 00000100:00100000:0.0:1789446006.229376:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742075008 00000100:00100000:0.0:1789446006.229419:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742075136 00000100:00100000:0.0:1789446006.229422:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742075136 00000100:00100000:0.0:1789446006.229439:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789446006.229448:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a304700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c012be7-6701-48ad-95ae-ff4709bfdc58+4:16474:x1876369742075008:12345-0@lo:104: 00010000:00010000:0.0:1789446006.229463:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d4725734c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47257353 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.229517:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789446006.229523:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a304700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c012be7-6701-48ad-95ae-ff4709bfdc58+4:16474:x1876369742075008:12345-0@lo:104: Request processed in 77us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446006.229531:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789446006.229552:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789446006.229558:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a306680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c012be7-6701-48ad-95ae-ff4709bfdc58+3:16474:x1876369742075136:12345-0@lo:104: 00010000:00010000:0.0:1789446006.229566:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afeb57be200/0xc1b37c4d47257211 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47257218 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.229597:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789446006.229602:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a306680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c012be7-6701-48ad-95ae-ff4709bfdc58+3:16474:x1876369742075136:12345-0@lo:104: Request processed in 45us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446006.229608:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789446006.229628:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789446006.229634:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d4725734c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47257353 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.229641:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57bfa00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1789446006.229646:0:14345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d4725734c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47257353 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.229665:0:14345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d4725734c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47257353 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446006.229672:0:14345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d4725734c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47257353 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446006.229679:0:14345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789446006.229705:0:14345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d4725734c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47257353 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.229712:0:14345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789446006.229733:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d4725734c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47257353 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.229741:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afeb57bfa00/0xc1b37c4d4725734c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47257353 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.229755:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446006.229758:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afeb57be200/0xc1b37c4d47257211 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d47257218 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.229764:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb57be200 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1789446006.229767:0:14345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57be200/0xc1b37c4d47257211 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d47257218 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.229774:0:14345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afeb57be200/0xc1b37c4d47257211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d47257218 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446006.229781:0:14345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afeb57be200/0xc1b37c4d47257211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d47257218 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446006.229805:0:14345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789446006.229820:0:14345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afeb57be200/0xc1b37c4d47257211 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47257218 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.229826:0:14345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789446006.229842:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afeb57be200/0xc1b37c4d47257211 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47257218 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.229849:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afeb57be200/0xc1b37c4d47257211 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d47257218 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.229859:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446006.229861:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446006.229863:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446006.229877:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c012be7-6701-48ad-95ae-ff4709bfdc58:3313:1876369742075264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789446006.229905:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446006.229938:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c012be7-6701-48ad-95ae-ff4709bfdc58:3310:1876369742075392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789446006.229961:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789446006.229998:0:16474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afeb57be600/0xc1b37c4d472571cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1b37c4d472571c4 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.230008:0:16474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afeb57be600/0xc1b37c4d472571cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1b37c4d472571c4 expref: 18 pid: 14350 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446006.230017:0:16474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a306300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1876369742075520:0@lo:104: 00000100:00100000:0.0:1789446006.230041:0:16474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446006.230089:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789446006.230099:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742075520 00000100:00100000:0.0:1789446006.230108:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742075520 00000100:00100000:0.0:1789446006.230130:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789446006.230136:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf6ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c012be7-6701-48ad-95ae-ff4709bfdc58+3:16474:x1876369742075520:12345-0@lo:104: 00010000:00010000:0.0:1789446006.230144:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.159@tcp lock: ffff9afe8e988c00/0xc1b37c4d472571c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d472571cb expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.230176:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789446006.230181:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf6ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c012be7-6701-48ad-95ae-ff4709bfdc58+3:16474:x1876369742075520:12345-0@lo:104: Request processed in 46us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446006.230187:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789446006.230231:0:16474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe90c44780 going to sleep for 11 seconds 00000100:00100000:0.0:1789446006.230251:0:16474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a305f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1876369742075008:0@lo:104: 00000100:00100000:0.0:1789446006.230259:0:16474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a307480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1876369742075136:0@lo:104: 00000100:00100000:1.0:1789446006.230265:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742075264 00000100:00100000:0.0:1789446006.230265:0:16474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a306300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1876369742075520:0@lo:104: 00000100:00100000:1.0:1789446006.230269:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742075264 00000100:00100000:0.0:1789446006.230288:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742075392 00010000:00010000:1.0:1789446006.230289:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257353 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d4725734c expref: 19 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446006.230291:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742075392 00010000:00010000:0.0:1789446006.230301:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe91b6fe00/0xc1b37c4d47257218 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47257211 expref: 20 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446006.230310:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789446006.230313:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789446006.230315:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a304a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c012be7-6701-48ad-95ae-ff4709bfdc58+20:3313:x1876369742075264:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789446006.230318:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a307800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c012be7-6701-48ad-95ae-ff4709bfdc58+20:3310:x1876369742075392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789446006.230325:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789446006.230325:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446006.230330:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257353 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d4725734c expref: 20 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.230330:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe91b6fe00/0xc1b37c4d47257218 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d47257211 expref: 20 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.230339:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe91b6fe00/0xc1b37c4d47257218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d47257211 expref: 20 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446006.230520:0:15680:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789446006.230527:0:15680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.159@tcp lock: ffff9afe8e988c00/0xc1b37c4d472571c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1b37c4d472571cb expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446006.230535:0:15680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988c00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1789446006.230539:0:15680:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e988c00/0xc1b37c4d472571c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1b37c4d472571cb expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446006.230545:0:15680:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.159@tcp lock: ffff9afe8e988c00/0xc1b37c4d472571c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1b37c4d472571cb expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789446006.230552:0:15680:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.159@tcp lock: ffff9afe8e988c00/0xc1b37c4d472571c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1b37c4d472571cb expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446006.230558:0:15680:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789446006.230576:0:15680:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.159@tcp lock: ffff9afe8e988c00/0xc1b37c4d472571c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d472571cb expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446006.230593:0:15680:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789446006.230612:0:15680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.159@tcp lock: ffff9afe8e988c00/0xc1b37c4d472571c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d472571cb expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446006.230618:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.159@tcp lock: ffff9afe8e988c00/0xc1b37c4d472571c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1b37c4d472571cb expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446006.230631:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446006.230633:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446006.230634:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446006.230649:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446006.230660:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c012be7-6701-48ad-95ae-ff4709bfdc58:3311:1876369742075648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789446006.230690:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446006.230738:0:14342:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789446006.230746:0:14342:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789446006.231890:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742075648 00000100:00100000:2.0:1789446006.231898:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742075648 00010000:00010000:2.0:1789446006.231926:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afeb57be600/0xc1b37c4d472571cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d472571c4 expref: 21 pid: 14350 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446006.232219:0:16476:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1789446006.232228:0:16476:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1789446006.233269:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d4725734c expref: 21 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446006.233290:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afeb57be400/0xc1b37c4d47257353 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d4725734c expref: 21 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446006.233304:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789446006.233389:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a304a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c012be7-6701-48ad-95ae-ff4709bfdc58+20:3313:x1876369742075264:12345-0@lo:103:ldlm_bl.0 Request processed in 3072us (3481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446006.233397:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789446006.233425:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789446006.233435:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5b03450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:3311:x1876369742075648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789446006.233452:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446006.233458:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afeb57be600/0xc1b37c4d472571cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1b37c4d472571c4 expref: 19 pid: 14350 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446006.233473:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afeb57be600/0xc1b37c4d472571cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1b37c4d472571c4 expref: 19 pid: 14350 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446006.233483:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afeb57be600/0xc1b37c4d472571cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d472571c4 expref: 19 pid: 14350 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446006.233494:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789446006.233526:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5b03450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:3311:x1876369742075648:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (2835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446006.233533:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789446006.233587:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c012be7-6701-48ad-95ae-ff4709bfdc58:3311:1876369742075648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789446006.236126:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c012be7-6701-48ad-95ae-ff4709bfdc58:3313:1876369742075264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789446006.237071:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446006.237153:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446006.237180:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722161280 00000100:00100000:1.0:1789446006.237188:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722161280 00010000:00010000:1.0:1789446006.237221:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afeba8f4800/0xc1b37c4d47257472 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f19 expref: 13 pid: 14350 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446006.237249:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722161152 00000100:00100000:1.0:1789446006.237252:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722161152 00010000:00010000:1.0:1789446006.237265:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d472574aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f7b expref: 14 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446006.237283:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:1.0:1789446006.237291:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+14:2374:x1876369722161280:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789446006.237305:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446006.237310:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afeba8f4800/0xc1b37c4d47257472 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f19 expref: 14 pid: 14350 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446006.237337:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afeba8f4800/0xc1b37c4d47257472 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f19 expref: 14 pid: 14350 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446006.237360:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789446006.237415:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+14:2374:x1876369722161280:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 123us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446006.237423:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:1.0:1789446006.237443:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 8 00000100:00100000:1.0:1789446006.237450:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba0f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:2374:x1876369722161152:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789446006.237472:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446006.237477:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d472574aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f7b expref: 13 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446006.237488:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d472574aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f7b expref: 13 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446006.237498:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789446006.237515:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba0f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:2374:x1876369722161152:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 66us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446006.237521:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 8 00010000:00010000:3.0:1789446006.238220:0:16474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d472574aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f7b expref: 12 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446006.238238:0:16474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1876369742074752:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789446006.238250:0:16474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afeba8f4800/0xc1b37c4d47257472 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f19 expref: 11 pid: 14350 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446006.238259:0:16474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeba5cd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1876369742074880:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789446006.238303:0:16474:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afea4907200/0xc1b37c4d472574d4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.238719:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afe91b6fe00/0xc1b37c4d47257218 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1b37c4d47257211 expref: 17 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.238752:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afea4907200/0xc1b37c4d472574d4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.238762:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afea4907200/0xc1b37c4d472574d4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.238780:0:14344:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afea4907200/0xc1b37c4d472574d4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.238801:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afea4907200/0xc1b37c4d472574d4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.238809:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afea4907200/0xc1b37c4d472574d4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.238817:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afea4907200/0xc1b37c4d472574d4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.238824:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907200 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789446006.238829:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afea4907200/0xc1b37c4d472574d4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.238837:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afea4907200/0xc1b37c4d472574d4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.238861:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afea4907200/0xc1b37c4d472574d4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446006.238873:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789446006.238944:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a307800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:3310:x1876369742075392:12345-0@lo:103:ldlm_bl.0 Request processed in 8625us (8982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446006.238959:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789446006.239100:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c012be7-6701-48ad-95ae-ff4709bfdc58:3310:1876369742075392:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789446006.240828:0:16474:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afea4907200/0xc1b37c4d472574d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446006.240847:0:16474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afea4907200/0xc1b37c4d472574d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446006.240855:0:16474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afea4907200/0xc1b37c4d472574d4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446006.874283:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446006.878638:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe9ee7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742075776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789446006.878715:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446006.882210:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742075776 00000100:00100000:2.0:1789446006.882223:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742075776 00000100:00100000:2.0:1789446006.882337:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789446006.882356:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742075776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789446006.882408:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789446006.882516:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742075776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (3800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446006.882523:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789446006.882757:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe9ee7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742075776:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789446006.883238:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1789446007.391301:0:14354:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789446007.391308:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afe9f932000 from 10 10000000:01000000:0.0:1789446007.391313:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789446007.391361:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afea4906a00/0xc1b37c4d472574db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446007.391374:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afea4906a00/0xc1b37c4d472574db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446007.391386:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afea4906a00/0xc1b37c4d472574db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446007.391409:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742075904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789446007.391474:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446007.391527:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeadb5fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789446007.391576:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742075904 00000100:00100000:3.0:1789446007.391584:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742075904 00000100:00100000:3.0:1789446007.391647:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789446007.391658:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe89963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+16:14354:x1876369742075904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789446007.391672:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446007.391685:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d472574e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472574db expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446007.391708:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d472574e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472574db expref: 17 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446007.391718:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afe8e989a00/0xc1b37c4d472574e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472574db expref: 17 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446007.391727:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989a00, rc 0) 00000100:00100000:3.0:1789446007.391763:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe89963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+17:14354:x1876369742075904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446007.391770:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789446007.391968:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742075904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789446007.391982:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afea4906a00/0xc1b37c4d472574db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472574e2 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446007.391991:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afea4906a00/0xc1b37c4d472574db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472574e2 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446007.392068:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742076032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789446007.392097:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446007.392124:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeadb5fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789446007.392245:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742076032 00000100:00100000:3.0:1789446007.392249:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742076032 00000100:00100000:3.0:1789446007.392281:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789446007.392287:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe96264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+17:14354:x1876369742076032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789446007.392528:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe96264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+17:14354:x1876369742076032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446007.392535:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789446007.394969:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742076032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789446007.395021:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742076160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789446007.395092:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446007.395119:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeadb5fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789446007.395221:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742076160 00000100:00100000:3.0:1789446007.395231:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742076160 00000100:00100000:3.0:1789446007.395311:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789446007.395329:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe96264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+17:14354:x1876369742076160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789446007.395617:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe96264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+17:14354:x1876369742076160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 294us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446007.395632:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789446007.396169:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742076160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789446007.400563:0:16533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789446007.409104:0:14354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789446007.409155:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789446007.409167:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afea4906a00/0xc1b37c4d472574db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472574e2 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446007.409180:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afea4906a00/0xc1b37c4d472574db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472574e2 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446007.409192:0:14354:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789446007.409195:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afeb5c89800 from 10 10000000:01000000:2.0:1789446007.409197:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789446007.409234:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeba8f4c00/0xc1b37c4d472574e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446007.409242:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afeba8f4c00/0xc1b37c4d472574e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446007.409253:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afeba8f4c00/0xc1b37c4d472574e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446007.409280:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742076288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789446007.409350:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446007.409387:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896bb480 going to sleep for 11 seconds 00000100:00100000:0.0:1789446007.409588:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742076288 00000100:00100000:0.0:1789446007.409596:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742076288 00000100:00100000:0.0:1789446007.409639:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789446007.409648:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe96267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+17:14354:x1876369742076288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789446007.409662:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789446007.409674:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afea4907800/0xc1b37c4d472574f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472574e9 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446007.409696:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afea4907800/0xc1b37c4d472574f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472574e9 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446007.409707:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afea4907800/0xc1b37c4d472574f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472574e9 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446007.409715:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907800, rc 0) 00000100:00100000:0.0:1789446007.409758:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe96267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:14354:x1876369742076288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446007.409765:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789446007.409826:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742076288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789446007.409839:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afeba8f4c00/0xc1b37c4d472574e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472574f0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446007.409854:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afeba8f4c00/0xc1b37c4d472574e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472574f0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446007.409904:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742076416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789446007.409930:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446007.409949:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeadb5f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789446007.409977:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742076416 00000100:00100000:0.0:1789446007.409981:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742076416 00000100:00100000:0.0:1789446007.410015:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789446007.410022:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:14354:x1876369742076416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789446007.410294:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:14354:x1876369742076416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446007.410301:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789446007.410332:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742076416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789446007.410361:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742076544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789446007.410399:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446007.410413:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeadb5f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789446007.410425:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742076544 00000100:00100000:0.0:1789446007.410428:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742076544 00000100:00100000:0.0:1789446007.410448:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789446007.410455:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:14354:x1876369742076544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789446007.410595:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:14354:x1876369742076544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446007.410601:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789446007.410647:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742076544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789446007.411367:0:16536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789446007.411416:0:14354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789446007.411436:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789446007.411445:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afeba8f4c00/0xc1b37c4d472574e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472574f0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446007.411455:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afeba8f4c00/0xc1b37c4d472574e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472574f0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446007.411464:0:14354:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789446007.411466:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afeada0c800 from 10 10000000:01000000:0.0:1789446007.411469:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789446007.411493:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afea4906800/0xc1b37c4d472574f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446007.411501:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.159@tcp lock: ffff9afea4906800/0xc1b37c4d472574f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446007.411509:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.159@tcp lock: ffff9afea4906800/0xc1b37c4d472574f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446007.411524:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742076672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789446007.411558:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446007.411575:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeadb5f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789446007.411590:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742076672 00000100:00100000:0.0:1789446007.411594:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742076672 00000100:00100000:0.0:1789446007.411619:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789446007.411626:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+18:14354:x1876369742076672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789446007.411644:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789446007.411653:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afea4907e00/0xc1b37c4d472574fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1b37c4d472574f7 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446007.411672:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afea4907e00/0xc1b37c4d472574fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1b37c4d472574f7 expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446007.411680:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afea4907e00/0xc1b37c4d472574fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1b37c4d472574f7 expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446007.411688:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907e00, rc 0) 00000100:00100000:0.0:1789446007.411716:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:14354:x1876369742076672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446007.411722:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789446007.411755:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742076672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789446007.411766:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.159@tcp lock: ffff9afea4906800/0xc1b37c4d472574f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472574fe expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446007.411774:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.159@tcp lock: ffff9afea4906800/0xc1b37c4d472574f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1b37c4d472574fe expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446007.411823:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742076800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789446007.411843:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446007.411855:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeadb5f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789446007.411865:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742076800 00000100:00100000:0.0:1789446007.411868:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742076800 00000100:00100000:0.0:1789446007.411885:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789446007.411890:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:14354:x1876369742076800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789446007.412087:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:14354:x1876369742076800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446007.412094:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789446007.412122:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742076800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789446007.412146:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742076928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789446007.412180:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446007.412202:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afeadb5f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789446007.412213:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742076928 00000100:00100000:0.0:1789446007.412216:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742076928 00000100:00100000:0.0:1789446007.412237:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789446007.412242:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:14354:x1876369742076928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789446007.415472:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:14354:x1876369742076928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3221us (3283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446007.415487:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789446007.419264:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c012be7-6701-48ad-95ae-ff4709bfdc58:14354:1876369742076928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789446007.420325:0:16537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789446007.422527:0:14354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789446007.422558:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789446007.422569:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.159@tcp lock: ffff9afea4906800/0xc1b37c4d472574f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472574fe expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446007.422581:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.159@tcp lock: ffff9afea4906800/0xc1b37c4d472574f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1b37c4d472574fe expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446007.902808:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446008.162418:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446008.166556:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722161408 00000100:00100000:0.0:1789446008.166671:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722161408 00000100:00100000:0.0:1789446008.167113:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 117 00000100:00100000:0.0:1789446008.167127:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+11:13790:x1876369722161408:12345-192.168.206.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789446008.167158:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789446008.167183:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afea4907000/0xc1b37c4d47257505 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4fac expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446008.167220:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afea4907000/0xc1b37c4d47257505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fac expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446008.167246:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afea4907000/0xc1b37c4d47257505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fac expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446008.167257:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907000, rc 0) 00000100:00100000:0.0:1789446008.167345:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0da5c432-b9e3-4d15-b46a-529046cbdbfd+12:13790:x1876369722161408:12345-192.168.206.59@tcp:101:ll_cfg_requeue.0 Request processed in 221us (4941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446008.167353:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 117 00000100:00100000:3.0:1789446008.169398:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446008.173196:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722161536 00000100:00100000:2.0:1789446008.173231:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722161536 00000100:00100000:2.0:1789446008.173320:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 118 00000100:00100000:2.0:1789446008.173332:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f97c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+12:13790:x1876369722161536:12345-192.168.206.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789446008.173788:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f97c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+12:13790:x1876369722161536:12345-192.168.206.59@tcp:501:ll_cfg_requeue.0 Request processed in 445us (4387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446008.173798:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 118 00000100:00100000:3.0:1789446008.181316:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446008.181547:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722161664 00000100:00100000:2.0:1789446008.181569:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722161664 00000100:00100000:2.0:1789446008.181941:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 119 00000100:00100000:2.0:1789446008.181954:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+12:13790:x1876369722161664:12345-192.168.206.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789446008.188536:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+12:13790:x1876369722161664:12345-192.168.206.59@tcp:503:ll_cfg_requeue.0 Request processed in 6568us (7218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446008.188557:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 119 00000100:00100000:3.0:1789446008.195652:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446008.196144:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722161792 00000100:00100000:0.0:1789446008.196158:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722161792 00000100:00100000:0.0:1789446008.196541:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 120 00000100:00100000:0.0:1789446008.196560:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f97c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+12:13790:x1876369722161792:12345-192.168.206.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789446008.196583:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789446008.196607:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afea4906e00/0xc1b37c4d4725750c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4fb3 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446008.196642:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afea4906e00/0xc1b37c4d4725750c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fb3 expref: 13 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446008.196654:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afea4906e00/0xc1b37c4d4725750c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fb3 expref: 13 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446008.196685:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4906e00, rc 0) 00000100:00100000:0.0:1789446008.196793:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f97c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:13790:x1876369722161792:12345-192.168.206.59@tcp:101:ll_cfg_requeue.0 Request processed in 238us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446008.199865:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 120 00000100:00100000:0.0:1789446008.200003:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446008.200103:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722161920 00000100:00100000:3.0:1789446008.200112:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722161920 00000100:00100000:2.0:1789446008.200345:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 121 00000100:00100000:2.0:1789446008.200357:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f97c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:13790:x1876369722161920:12345-192.168.206.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789446008.201174:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f97c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:13790:x1876369722161920:12345-192.168.206.59@tcp:501:ll_cfg_requeue.0 Request processed in 816us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446008.201187:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 121 00000100:00100000:2.0:1789446008.206252:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446008.206662:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722162048 00000100:00100000:1.0:1789446008.206675:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722162048 00000100:00100000:1.0:1789446008.206789:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 122 00000100:00100000:1.0:1789446008.206801:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f97f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:13790:x1876369722162048:12345-192.168.206.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789446008.207130:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f97f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:13790:x1876369722162048:12345-192.168.206.59@tcp:503:ll_cfg_requeue.0 Request processed in 330us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446008.207140:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 122 00000100:00100000:2.0:1789446008.410866:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789446008.410905:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742077056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789446008.411008:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446008.411232:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742077056 00000100:00100000:2.0:1789446008.411244:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742077056 00000100:00100000:2.0:1789446008.411328:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789446008.411340:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81214380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742077056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789446008.411383:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789446008.411445:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81214380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742077056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446008.411470:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1789446008.411497:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789446008.411563:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c012be7-6701-48ad-95ae-ff4709bfdc58:3310:1876369742077184:0@lo:400:kworker.0 00000100:00100000:2.0:1789446008.411607:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742077312:0@lo:400:kworker.0 00000100:00100000:0.0:1789446008.411629:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446008.411666:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446008.411674:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369742077696:0@lo:400:kworker.0 00000100:00100000:2.0:1789446008.411707:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369742077568:0@lo:400:kworker.0 00000100:00100000:0.0:1789446008.411715:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446008.411747:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446008.411804:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789446008.411811:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876369742077440:0@lo:400:kworker.0 00000100:00100000:2.0:1789446008.411841:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446008.411903:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742077056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789446008.413477:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742077184 00000100:00100000:1.0:1789446008.413494:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742077184 00000100:00100000:1.0:1789446008.413552:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789446008.413562:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f97ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:3310:x1876369742077184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446008.413833:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f97ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:3310:x1876369742077184:12345-0@lo:400:kworker.0 Request processed in 272us (2204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446008.413852:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789446008.413947:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c012be7-6701-48ad-95ae-ff4709bfdc58:3310:1876369742077184:0@lo:400:kworker.0 00000100:00100000:1.0:1789446008.414555:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742077696 00000100:00100000:1.0:1789446008.414564:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742077696 00000100:00100000:1.0:1789446008.415127:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742077568 00000100:00100000:1.0:1789446008.415133:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742077568 00000100:00100000:1.0:1789446008.415150:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742077440 00000100:00100000:1.0:1789446008.415153:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742077440 00000100:00100000:1.0:1789446008.415169:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789446008.415177:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876369742077696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446008.415254:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876369742077696:12345-0@lo:400:kworker.0 Request processed in 78us (3542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446008.415263:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789446008.415279:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789446008.415285:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369742077568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446008.415322:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876369742077568:12345-0@lo:400:kworker.0 Request processed in 37us (3576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446008.415351:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789446008.415362:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789446008.415368:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876369742077440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446008.415400:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876369742077440:12345-0@lo:400:kworker.0 Request processed in 32us (3559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446008.415406:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789446008.415428:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742077312 00000100:00100000:1.0:1789446008.415433:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742077312 00000100:00100000:1.0:1789446008.415474:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789446008.415483:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742077312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446008.415528:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742077312:12345-0@lo:400:kworker.0 Request processed in 47us (3862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446008.415535:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789446008.415605:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742077312:0@lo:400:kworker.0 00000100:00100000:1.0:1789446008.415649:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369742077696:0@lo:400:kworker.0 00000100:00100000:1.0:1789446008.415765:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876369742077440:0@lo:400:kworker.0 00000100:00100000:1.0:1789446008.415789:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876369742077568:0@lo:400:kworker.0 00000100:00080000:3.0:1789446008.415961:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789446008.415968:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789446008.922314:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789446009.554360:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446009.554759:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722162176 00000100:00100000:1.0:1789446009.554781:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722162176 00000100:00100000:1.0:1789446009.554876:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 15 00000100:00100000:1.0:1789446009.554890:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+6:14442:x1876369722162176:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789446009.554914:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446009.554941:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d47257513 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4fba expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.555083:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725751a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.555101:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725751a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.555119:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725751a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.555135:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257521 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.555143:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.555151:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556152:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1e00/0xc1b37c4d47257528 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556170:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1e00/0xc1b37c4d47257528 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556182:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1e00/0xc1b37c4d47257528 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446009.556219:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789446009.556223:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789446009.556270:0:14358:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1e00/0xc1b37c4d47257528 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556296:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725751a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556303:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725751a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556311:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725751a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556318:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c1200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789446009.556323:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725751a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556331:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725751a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556346:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961b00) 00010000:00010000:1.0:1789446009.556349:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446009.556355:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725751a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556361:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725751a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556375:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556382:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257521 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556387:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257521 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556399:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789446009.556403:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257521 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556429:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257521 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556439:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9afe88661700) 00010000:00010000:1.0:1789446009.556442:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446009.556445:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257521 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556451:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257521 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556502:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d47257513 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fba expref: 8 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556518:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1e00/0xc1b37c4d47257528 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fba expref: 7 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.556536:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9afe88661e00) 00010000:00010000:1.0:1789446009.556539:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789446009.556542:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd832c1e00, rc 0) 00000100:00100000:1.0:1789446009.556645:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+7:14442:x1876369722162176:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 1758us (2299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446009.556655:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 15 00000100:00080000:3.0:1789446009.556912:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789446009.561375:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446009.561498:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722162432 00000100:00100000:1.0:1789446009.562551:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722162432 00000100:00100000:1.0:1789446009.562647:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 16 00000100:00100000:1.0:1789446009.562666:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+7:14442:x1876369722162432:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789446009.562696:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446009.563651:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d4725752f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4fc1 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.563928:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257536 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.563946:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257536 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.563961:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257536 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.564569:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725753d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.564592:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725753d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.564604:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725753d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.565016:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1a00/0xc1b37c4d47257544 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.565025:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1a00/0xc1b37c4d47257544 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.565033:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1a00/0xc1b37c4d47257544 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446009.565078:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789446009.565281:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257536 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.565289:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257536 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.565295:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257536 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.565301:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789446009.565304:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257536 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.565311:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257536 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.565323:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9afe88661e00) 00010000:00010000:1.0:1789446009.565326:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446009.565332:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257536 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.565338:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257536 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.565350:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725753d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.565356:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725753d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.567831:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725753d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.567838:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c1200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789446009.567843:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725753d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.567852:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725753d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.567868:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9afe88661700) 00010000:00010000:1.0:1789446009.567871:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446009.567876:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725753d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.567882:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d4725753d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.571221:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d4725752f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fc1 expref: 10 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.571245:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1a00/0xc1b37c4d47257544 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fc1 expref: 9 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.571254:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afe88661400) 00010000:00010000:1.0:1789446009.571257:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446009.571260:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd832c1a00, rc 0) 00000100:00100000:1.0:1789446009.571342:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+9:14442:x1876369722162432:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 8683us (9980us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789446009.576079:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 16 00000100:00100000:3.0:1789446009.594704:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446009.594818:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722162560 00000100:00100000:1.0:1789446009.594831:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722162560 00000100:00100000:1.0:1789446009.594898:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 17 00000100:00100000:1.0:1789446009.594909:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+9:14442:x1876369722162560:12345-192.168.206.59@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789446009.595020:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+9:14442:x1876369722162560:12345-192.168.206.59@tcp:59:lhsmtool_posix.0 Request processed in 112us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446009.595027:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 17 00000100:00100000:3.0:1789446009.606599:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446009.606715:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722162688 00000100:00100000:1.0:1789446009.606727:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722162688 00000100:00100000:1.0:1789446009.606806:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 18 00000100:00100000:1.0:1789446009.606817:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+9:14448:x1876369722162688:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:1.0:1789446009.606844:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446009.606866:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d47257552 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4fc8 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.606951:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257559 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.606969:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257559 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.606982:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257559 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.606998:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257560 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.607034:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.607042:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.607626:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257559 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.607636:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257559 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.607644:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257559 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.607648:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c1200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789446009.607652:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257559 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.607658:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257559 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.607671:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961b00) 00010000:00010000:0.0:1789446009.607673:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789446009.607683:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257559 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.607688:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257559 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.607701:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.607705:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257560 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.607708:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257560 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.607711:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789446009.607713:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257560 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.607716:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257560 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.607720:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9afe88661700) 00010000:00010000:0.0:1789446009.607721:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789446009.607722:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257560 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.607725:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257560 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.607757:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d47257552 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fc8 expref: 10 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.607787:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961b00) 00010000:00010000:0.0:1789446009.607789:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789446009.607793:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d47257552 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fc8 expref: 10 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.607803:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd832c1800, rc 0) 00000100:00100000:0.0:1789446009.607886:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+9:14448:x1876369722162688:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 1070us (1309us total) trans 0 rc 301/301 00000100:00100000:0.0:1789446009.607899:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 18 00000100:00100000:0.0:1789446009.613821:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446009.614034:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722162816 00000100:00100000:3.0:1789446009.614136:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722162816 00000100:00100000:3.0:1789446009.614213:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 0 00000100:00100000:3.0:1789446009.614226:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+9:14448:x1876369722162816:12345-192.168.206.59@tcp:700:lfs.0 00000100:00100000:3.0:1789446009.614343:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+9:14448:x1876369722162816:12345-192.168.206.59@tcp:700:lfs.0 Request processed in 120us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446009.614351:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 0 00000100:00100000:3.0:1789446009.616214:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446009.616403:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722163072 00000100:00100000:2.0:1789446009.616415:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722163072 00000100:00100000:2.0:1789446009.616532:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 19 00000100:00100000:2.0:1789446009.616545:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+9:14448:x1876369722163072:12345-192.168.206.59@tcp:36:lfs.0 00010000:00010000:2.0:1789446009.616620:0:14359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789446009.616654:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d47257495 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4f43 expref: 9 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.616681:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961b00) 00010000:00010000:2.0:1789446009.616688:0:14359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789446009.616957:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257567 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.616974:0:14359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d472574cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fa5 expref: 5 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.616996:0:14359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257567 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.617037:0:14359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d472574cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fa5 expref: 5 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.617114:0:14359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d472574cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fa5 expref: 5 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446009.617132:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9f1c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14359:1876369742077824:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789446009.617249:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe896bb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789446009.619849:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446009.619849:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9f1c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14359:1876369742077824:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789446009.619879:0:14359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257567 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446009.619945:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722163200 00000100:00100000:3.0:1789446009.619953:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722163200 00010000:00010000:3.0:1789446009.620014:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d472574cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fa5 expref: 6 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446009.620076:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00100000:3.0:1789446009.620087:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5773df71-2069-48bb-a13d-12dd45acbeba+6:2374:x1876369722163200:12345-192.168.206.59@tcp:103:ldlm_bl.0 00000100:00080000:2.0:1789446009.620100:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789446009.620105:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789446009.620113:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d472574cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fa5 expref: 6 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446009.620126:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d472574cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fa5 expref: 6 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446009.620151:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d472574cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fa5 expref: 6 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446009.620169:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961b00) 00010000:00010000:3.0:1789446009.620175:0:14343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257567 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446009.620186:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257567 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446009.620199:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257567 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446009.620221:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789446009.620277:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5773df71-2069-48bb-a13d-12dd45acbeba+5:2374:x1876369722163200:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 191us (436us total) trans 0 rc 0/0 00010000:00010000:1.0:1789446009.620294:0:14359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257567 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.620302:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257567 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446009.620303:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 9 00010000:00010000:1.0:1789446009.620330:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0c00/0xc1b37c4d4725756e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.620341:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0c00/0xc1b37c4d4725756e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.620350:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0c00/0xc1b37c4d4725756e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446009.625191:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789446009.625220:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257567 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.625354:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257567 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.625380:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257567 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.625387:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f5800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789446009.625392:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257567 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.625406:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257567 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.625439:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe98961b00) 00010000:00010000:1.0:1789446009.625443:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446009.625449:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257567 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.625456:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257567 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789446009.625484:0:14359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aec57005 reply state 00000000f9e42412 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0c00/0xc1b37c4d4725756e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446009.625495:0:14359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789446009.625647:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+10:14448:x1876369722163072:12345-192.168.206.59@tcp:36:lfs.0 Request processed in 9101us (9439us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789446009.625657:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 19 00010000:00010000:0.0:1789446009.634091:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0c00/0xc1b37c4d4725756e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.634113:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0c00/0xc1b37c4d4725756e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.634123:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0c00/0xc1b37c4d4725756e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.634130:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789446009.634135:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0c00/0xc1b37c4d4725756e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.634144:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0c00/0xc1b37c4d4725756e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.634164:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9afe88661500) 00010000:00010000:0.0:1789446009.634167:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789446009.634190:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0c00/0xc1b37c4d4725756e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.634197:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0c00/0xc1b37c4d4725756e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446009.709967:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446009.710219:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722163328 00000100:00100000:2.0:1789446009.710232:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722163328 00000100:00100000:2.0:1789446009.710345:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 20 00000100:00100000:2.0:1789446009.710358:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+9:14456:x1876369722163328:12345-192.168.206.59@tcp:101:lctl.0 00010000:00010000:2.0:1789446009.710391:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446009.710420:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4000/0xc1b37c4d47257575 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4fcf expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.710506:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5600/0xc1b37c4d4725757c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.710522:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5600/0xc1b37c4d4725757c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.710559:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5600/0xc1b37c4d4725757c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789446009.710607:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789446009.710612:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789446009.710662:0:14357:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5600/0xc1b37c4d4725757c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.710691:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4000/0xc1b37c4d47257575 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fcf expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.710960:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5600/0xc1b37c4d4725757c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fcf expref: 10 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.710971:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe82ec9100) 00010000:00010000:2.0:1789446009.710974:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789446009.710978:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeba8f5600, rc 0) 00000100:00100000:2.0:1789446009.711251:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+10:14456:x1876369722163328:12345-192.168.206.59@tcp:101:lctl.0 Request processed in 895us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446009.711260:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 20 00000100:00100000:2.0:1789446009.737992:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446009.738224:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722163456 00000100:00100000:1.0:1789446009.738238:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722163456 00000100:00100000:1.0:1789446009.738313:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 21 00000100:00100000:1.0:1789446009.738381:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5773df71-2069-48bb-a13d-12dd45acbeba+5:14457:x1876369722163456:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:1.0:1789446009.738441:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446009.738469:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0c00/0xc1b37c4d47257583 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4fd6 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.738558:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0e00/0xc1b37c4d4725758a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.738588:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0e00/0xc1b37c4d4725758a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.738604:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0e00/0xc1b37c4d4725758a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446009.738648:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789446009.738652:0:14359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789446009.738676:0:14359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0e00/0xc1b37c4d4725758a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.738703:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0c00/0xc1b37c4d47257583 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fd6 expref: 7 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.738728:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0e00/0xc1b37c4d4725758a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fd6 expref: 6 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.738736:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe82ec9100) 00010000:00010000:1.0:1789446009.738740:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789446009.738744:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd832c0e00, rc 0) 00000100:00100000:1.0:1789446009.738843:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5773df71-2069-48bb-a13d-12dd45acbeba+6:14457:x1876369722163456:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 520us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446009.738851:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 21 00000100:00100000:0.0:1789446009.741997:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446009.742287:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722163584 00000100:00100000:2.0:1789446009.742301:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722163584 00000100:00100000:2.0:1789446009.742372:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 22 00000100:00100000:2.0:1789446009.742384:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5773df71-2069-48bb-a13d-12dd45acbeba+6:14457:x1876369722163584:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:2.0:1789446009.742412:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446009.742446:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4000/0xc1b37c4d47257591 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4fdd expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742543:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257598 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742562:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257598 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742640:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257598 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742658:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5200/0xc1b37c4d4725759f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742665:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5200/0xc1b37c4d4725759f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742672:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5200/0xc1b37c4d4725759f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742792:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5c00/0xc1b37c4d472575a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742801:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5c00/0xc1b37c4d472575a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742808:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5c00/0xc1b37c4d472575a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789446009.742849:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789446009.742853:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789446009.742875:0:14357:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5c00/0xc1b37c4d472575a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742902:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257598 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742910:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257598 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742918:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257598 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742925:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f5800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789446009.742930:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257598 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742939:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257598 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742954:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe82ec9100) 00010000:00010000:2.0:1789446009.742957:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789446009.742963:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257598 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742969:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5800/0xc1b37c4d47257598 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742983:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5200/0xc1b37c4d4725759f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742989:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5200/0xc1b37c4d4725759f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.742995:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5200/0xc1b37c4d4725759f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.743006:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f5200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789446009.743009:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5200/0xc1b37c4d4725759f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.743015:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5200/0xc1b37c4d4725759f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.743023:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9afe82ec9b00) 00010000:00010000:2.0:1789446009.743026:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789446009.743029:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5200/0xc1b37c4d4725759f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.743035:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5200/0xc1b37c4d4725759f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.743218:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4000/0xc1b37c4d47257591 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fdd expref: 8 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.743235:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5c00/0xc1b37c4d472575a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fdd expref: 7 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.743243:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afe82ec9000) 00010000:00010000:2.0:1789446009.743245:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789446009.743248:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeba8f5c00, rc 0) 00000100:00100000:2.0:1789446009.743392:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5773df71-2069-48bb-a13d-12dd45acbeba+7:14457:x1876369722163584:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 1008us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446009.743401:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 22 00000100:00100000:3.0:1789446009.746884:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446009.747304:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722163840 00000100:00100000:0.0:1789446009.747326:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722163840 00000100:00100000:0.0:1789446009.747411:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 23 00000100:00100000:0.0:1789446009.747425:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5773df71-2069-48bb-a13d-12dd45acbeba+7:14457:x1876369722163840:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:0.0:1789446009.747455:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789446009.747481:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472575ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4fe4 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789446009.747618:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789446009.749444:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472575ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fe4 expref: 9 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.749465:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe82ec9100) 00010000:00010000:0.0:1789446009.749467:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789446009.749472:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472575ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fe4 expref: 9 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.749484:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907a00, rc 0) 00000100:00100000:0.0:1789446009.749569:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5773df71-2069-48bb-a13d-12dd45acbeba+8:14457:x1876369722163840:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 2148us (2700us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789446009.749579:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 23 00000100:00100000:3.0:1789446009.752442:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446009.752956:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722164096 00000100:00100000:0.0:1789446009.752970:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722164096 00000100:00100000:0.0:1789446009.753074:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 24 00000100:00100000:0.0:1789446009.753088:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5773df71-2069-48bb-a13d-12dd45acbeba+8:14457:x1876369722164096:12345-192.168.206.59@tcp:36:lfs.0 00010000:00010000:0.0:1789446009.753479:0:14357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789446009.753516:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5c00/0xc1b37c4d472575a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4fdd expref: 8 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.753539:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afe82ec9000) 00010000:00010000:0.0:1789446009.753553:0:14357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789446009.753588:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d472575bb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.753603:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d472575bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.753615:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d472575bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789446009.753932:0:14357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4554d80 reply state 00000000daf7ccba transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d472575bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446009.753943:0:14357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789446009.753953:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789446009.754177:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5773df71-2069-48bb-a13d-12dd45acbeba+9:14457:x1876369722164096:12345-192.168.206.59@tcp:36:lfs.0 Request processed in 1090us (1750us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789446009.754185:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 24 00010000:00010000:3.0:1789446009.756926:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d472575bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446009.756960:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d472575bb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446009.756970:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d472575bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446009.756977:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4906c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789446009.756983:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d472575bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446009.756992:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d472575bb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446009.757013:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afe98961c00) 00010000:00010000:3.0:1789446009.757017:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789446009.757023:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d472575bb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446009.757029:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4906c00/0xc1b37c4d472575bb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446009.758101:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446009.758617:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722164352 00000100:00100000:2.0:1789446009.758651:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722164352 00000100:00100000:2.0:1789446009.758762:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 2 00000100:00100000:2.0:1789446009.758785:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5773df71-2069-48bb-a13d-12dd45acbeba+8:14457:x1876369722164352:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:2.0:1789446009.759183:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5773df71-2069-48bb-a13d-12dd45acbeba+9:14457:x1876369722164352:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 399us (1138us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789446009.759193:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 2 00000100:00100000:1.0:1789446009.764560:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446009.764720:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722164608 00000100:00100000:0.0:1789446009.764735:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722164608 00000100:00100000:0.0:1789446009.764828:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 25 00000100:00100000:0.0:1789446009.764861:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5773df71-2069-48bb-a13d-12dd45acbeba+9:14457:x1876369722164608:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:0.0:1789446009.764898:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789446009.764925:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472575c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4feb expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.765024:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472575c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.765088:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472575c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.765115:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472575c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.765151:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad200/0xc1b37c4d472575d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.765161:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad200/0xc1b37c4d472575d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.765168:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad200/0xc1b37c4d472575d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789446009.765335:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789446009.765486:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472575c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.765496:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472575c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.765503:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472575c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.765520:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afea4907200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789446009.765526:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472575c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.765536:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472575c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.765554:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe82ec9100) 00010000:00010000:0.0:1789446009.765558:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789446009.765565:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472575c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.765572:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907200/0xc1b37c4d472575c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.765590:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad200/0xc1b37c4d472575d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.765596:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad200/0xc1b37c4d472575d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.765603:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad200/0xc1b37c4d472575d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.765609:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb6aad200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789446009.765612:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad200/0xc1b37c4d472575d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.766446:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad200/0xc1b37c4d472575d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.766482:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9afe98961500) 00010000:00010000:0.0:1789446009.766485:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789446009.766490:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad200/0xc1b37c4d472575d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.766497:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad200/0xc1b37c4d472575d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.766643:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472575c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4feb expref: 11 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.766656:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe82ec9100) 00010000:00010000:1.0:1789446009.766659:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789446009.766663:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afea4907a00/0xc1b37c4d472575c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4feb expref: 11 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.766673:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afea4907a00, rc 0) 00000100:00100000:1.0:1789446009.766843:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5773df71-2069-48bb-a13d-12dd45acbeba+10:14457:x1876369722164608:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 1929us (2241us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789446009.766856:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 25 00000100:00100000:3.0:1789446009.770506:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446009.770784:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722164736 00000100:00100000:0.0:1789446009.770796:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722164736 00000100:00100000:0.0:1789446009.770865:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 26 00000100:00100000:0.0:1789446009.770879:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5773df71-2069-48bb-a13d-12dd45acbeba+10:14457:x1876369722164736:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:0.0:1789446009.770913:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789446009.770943:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad800/0xc1b37c4d472575de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ff2 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.772163:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d472575e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.772941:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d472575e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.772962:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d472575e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446009.773027:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789446009.773031:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789446009.773090:0:14357:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d472575e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.773153:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad800/0xc1b37c4d472575de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ff2 expref: 12 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.773205:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d472575e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ff2 expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.773215:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afe98961200) 00010000:00010000:1.0:1789446009.773218:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789446009.773223:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd832c1800, rc 0) 00000100:00100000:1.0:1789446009.773330:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5773df71-2069-48bb-a13d-12dd45acbeba+11:14457:x1876369722164736:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 2454us (2840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446009.773339:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 26 00000100:00100000:3.0:1789446009.780264:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446009.780415:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722164864 00000100:00100000:0.0:1789446009.780447:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722164864 00000100:00100000:0.0:1789446009.780560:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 3 00000100:00100000:0.0:1789446009.780573:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5773df71-2069-48bb-a13d-12dd45acbeba+11:14457:x1876369722164864:12345-192.168.206.59@tcp:37:lfs.0 00000100:00100000:3.0:1789446009.788657:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5773df71-2069-48bb-a13d-12dd45acbeba+11:14457:x1876369722164864:12345-192.168.206.59@tcp:37:lfs.0 Request processed in 8054us (8375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446009.788676:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 3 00000100:00100000:3.0:1789446009.797427:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446009.797978:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722165120 00000100:00100000:2.0:1789446009.797996:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722165120 00000100:00100000:2.0:1789446009.798158:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 4 00000100:00100000:2.0:1789446009.798170:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91916c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5773df71-2069-48bb-a13d-12dd45acbeba+11:14457:x1876369722165120:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:2.0:1789446009.799458:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91916c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5773df71-2069-48bb-a13d-12dd45acbeba+12:14457:x1876369722165120:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 1279us (2037us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789446009.799473:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 4 00000100:00100000:2.0:1789446009.840006:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446009.840600:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722165248 00000100:00100000:1.0:1789446009.840619:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722165248 00000100:00100000:1.0:1789446009.840697:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 27 00000100:00100000:1.0:1789446009.840710:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+10:14463:x1876369722165248:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:1.0:1789446009.840780:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446009.840806:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d472575ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba4ff9 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.840895:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d472575f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.840909:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d472575f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.840919:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d472575f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.840931:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d472575fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.840951:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d472575fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.840955:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d472575fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841094:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0000/0xc1b37c4d47257601 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841103:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0000/0xc1b37c4d47257601 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841110:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0000/0xc1b37c4d47257601 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446009.841144:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789446009.841148:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789446009.841198:0:14358:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0000/0xc1b37c4d47257601 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841219:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d472575f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841226:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d472575f3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841233:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d472575f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841239:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c1200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789446009.841243:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d472575f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841258:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d472575f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841274:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe82ec9100) 00010000:00010000:1.0:1789446009.841276:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446009.841282:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d472575f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841289:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d472575f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841304:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d472575fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841310:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d472575fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841316:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d472575fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841321:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789446009.841323:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d472575fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841328:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d472575fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841333:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9afe88661a00) 00010000:00010000:1.0:1789446009.841334:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446009.841336:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d472575fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841358:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d472575fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841395:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d472575ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ff9 expref: 12 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841410:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0000/0xc1b37c4d47257601 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ff9 expref: 11 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.841418:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afe98961200) 00010000:00010000:1.0:1789446009.841420:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789446009.841423:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd832c0000, rc 0) 00000100:00100000:1.0:1789446009.841505:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+11:14463:x1876369722165248:12345-192.168.206.59@tcp:101:bash.0 Request processed in 797us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446009.841513:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 27 00000100:00100000:0.0:1789446009.847559:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446009.847927:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722165504 00000100:00100000:1.0:1789446009.847942:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722165504 00000100:00100000:1.0:1789446009.848013:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 28 00000100:00100000:1.0:1789446009.848025:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+11:14463:x1876369722165504:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:1.0:1789446009.848081:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446009.848287:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257608 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba5000 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.848453:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d4725760f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.848470:0:14357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d472575e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ff2 expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.848497:0:14357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d4725760f lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.848537:0:14357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d472575e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ff2 expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.848554:0:14357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d472575e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ff2 expref: 11 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446009.848570:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeadb9ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14357:1876369742077952:192.168.206.59@tcp:104: 00000100:00100000:1.0:1789446009.849454:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b3900 going to sleep for 11 seconds 00000100:00100000:3.0:1789446009.855616:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446009.855830:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722165632 00000100:00100000:2.0:1789446009.855842:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722165632 00010000:00010000:2.0:1789446009.855896:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d472575e5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ff2 expref: 12 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446009.855949:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:2.0:1789446009.855961:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5773df71-2069-48bb-a13d-12dd45acbeba+12:2375:x1876369722165632:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789446009.855981:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789446009.855989:0:14342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d472575e5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ff2 expref: 12 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.856004:0:14342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d472575e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ff2 expref: 12 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.857489:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afe98961200) 00010000:00010000:2.0:1789446009.857504:0:14342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d4725760f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.857519:0:14342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d4725760f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.857528:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d4725760f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.857562:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789446009.857829:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5773df71-2069-48bb-a13d-12dd45acbeba+12:2375:x1876369722165632:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 1866us (2222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446009.857840:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 10 00010000:00010000:1.0:1789446009.859816:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d472575e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba4ff2 expref: 11 pid: 14357 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446009.859847:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeadb9ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14357:1876369742077952:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789446009.859876:0:14357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d4725760f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.859887:0:14357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d4725760f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.859894:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d4725760f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.859924:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257616 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.859938:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257616 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.859966:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257616 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.860935:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d4725761d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.860950:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d4725761d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.860962:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d4725761d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446009.860975:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789446009.861004:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d4725760f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.861012:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d4725760f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.861020:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d4725760f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.861027:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789446009.861032:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d4725760f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.861040:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d4725760f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.861077:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afe98961200) 00010000:00010000:1.0:1789446009.861080:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446009.861095:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d4725760f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.861102:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d4725760f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789446009.861230:0:14357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aad97a32 reply state 00000000ff90191e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257616 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446009.861242:0:14357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789446009.861295:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d47257608 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5000 expref: 14 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.861311:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d4725761d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5000 expref: 13 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.861319:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:1.0:1789446009.861321:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789446009.861323:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd832c0800, rc 0) 00000100:00100000:1.0:1789446009.861752:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+14:14463:x1876369722165504:12345-192.168.206.59@tcp:101:bash.0 Request processed in 13387us (13866us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789446009.861765:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 28 00010000:00010000:0.0:1789446009.876660:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257616 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.876685:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257616 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.876694:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257616 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.876729:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c1200 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:0.0:1789446009.876736:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257616 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.876745:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257616 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.876779:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9afe88661a00) 00010000:00010000:0.0:1789446009.876783:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789446009.876790:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257616 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446009.876796:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1200/0xc1b37c4d47257616 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446009.880028:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446009.880175:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722165760 00000100:00100000:1.0:1789446009.880193:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722165760 00000100:00100000:1.0:1789446009.880274:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 29 00000100:00100000:1.0:1789446009.880288:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+13:14463:x1876369722165760:12345-192.168.206.59@tcp:101:bash.0 00010000:00010000:1.0:1789446009.880325:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446009.880357:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d4725762b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba5007 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.880497:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257632 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.880516:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257632 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.880531:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257632 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446009.880597:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789446009.880603:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789446009.880630:0:14358:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257632 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.880642:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257632 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.880686:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0600/0xc1b37c4d4725762b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5007 expref: 15 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.880710:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257632 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5007 expref: 14 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446009.880719:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:1.0:1789446009.880723:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789446009.880727:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd832c0200, rc 0) 00000100:00100000:1.0:1789446009.880832:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+14:14463:x1876369722165760:12345-192.168.206.59@tcp:101:bash.0 Request processed in 547us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446009.880842:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 29 00000100:00100000:3.0:1789446009.883680:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446009.887902:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722166016 00000100:00100000:0.0:1789446009.887924:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722166016 00000100:00100000:0.0:1789446009.888080:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 5 00000100:00100000:0.0:1789446009.888093:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+14:14463:x1876369722166016:12345-192.168.206.59@tcp:35:bash.0 00000100:00100000:0.0:1789446009.888541:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+15:14463:x1876369722166016:12345-192.168.206.59@tcp:35:bash.0 Request processed in 449us (4873us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789446009.888550:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 5 00010000:00010000:2.0:1789446009.946512:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789446009.975217:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446009.975545:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722166272 00000100:00100000:2.0:1789446009.975560:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722166272 00000100:00100000:2.0:1789446009.975639:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 30 00000100:00100000:2.0:1789446009.975652:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+15:14473:x1876369722166272:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:2.0:1789446009.975687:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446009.975715:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4a00/0xc1b37c4d47257639 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba500e expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789446009.975855:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789446009.976026:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4a00/0xc1b37c4d47257639 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba500e expref: 17 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.976084:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afe82ec9100) 00010000:00010000:2.0:1789446009.976504:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789446009.976514:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4a00/0xc1b37c4d47257639 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba500e expref: 17 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446009.976534:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeba8f4a00, rc 0) 00000100:00100000:2.0:1789446009.976630:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+16:14473:x1876369722166272:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 980us (1429us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789446009.976639:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 30 00000100:00100000:3.0:1789446009.983209:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446009.983968:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722166528 00000100:00100000:1.0:1789446009.983982:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722166528 00000100:00100000:0.0:1789446009.984233:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00100000:0.0:1789446009.984252:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+16:14473:x1876369722166528:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:0.0:1789446009.985035:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+17:14473:x1876369722166528:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 782us (1833us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789446009.985122:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00100000:0.0:1789446010.018028:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446010.018216:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722166784 00000100:00100000:1.0:1789446010.018230:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722166784 00000100:00100000:1.0:1789446010.018303:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 31 00000100:00100000:1.0:1789446010.018316:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+17:14476:x1876369722166784:12345-192.168.206.59@tcp:101:lfs.0 00010000:00010000:1.0:1789446010.018347:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446010.018374:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d47257647 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba5015 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.018970:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1000/0xc1b37c4d4725764e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.018992:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1000/0xc1b37c4d4725764e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.019012:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1000/0xc1b37c4d4725764e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446010.019027:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789446010.019257:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d47257647 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5015 expref: 20 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.019278:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1000/0xc1b37c4d4725764e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5015 expref: 19 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.019288:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:1.0:1789446010.019291:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789446010.019296:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd832c1000, rc 0) 00000100:00100000:1.0:1789446010.019392:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+19:14476:x1876369722166784:12345-192.168.206.59@tcp:101:lfs.0 Request processed in 1078us (1377us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789446010.019401:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 31 00000100:00100000:1.0:1789446010.023073:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446010.023138:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446010.023288:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722167040 00000100:00100000:0.0:1789446010.023301:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722167040 00000100:00100000:0.0:1789446010.023381:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 0 00000100:00100000:0.0:1789446010.023395:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+19:2374:x1876369722167040:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789446010.023433:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789446010.023465:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1000/0xc1b37c4d4725764e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5015 expref: 19 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446010.023489:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:0.0:1789446010.023495:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789446010.023561:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+18:2374:x1876369722167040:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 169us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446010.023571:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 0 00000100:00100000:3.0:1789446010.024465:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722166912 00000100:00100000:3.0:1789446010.024476:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722166912 00000100:00100000:3.0:1789446010.024529:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 32 00000100:00100000:3.0:1789446010.024539:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeadb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+18:14476:x1876369722166912:12345-192.168.206.59@tcp:54:lfs.0 00010000:00010000:3.0:1789446010.024724:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d4725765c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446010.024745:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d4725765c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446010.024760:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d4725765c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446010.024809:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d4725765c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446010.024818:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d4725765c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446010.024826:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d4725765c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446010.024833:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789446010.024856:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d4725765c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446010.024865:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d4725765c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446010.024879:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:3.0:1789446010.024883:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789446010.024888:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d4725765c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446010.024896:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d4725765c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446010.024975:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeadb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+18:14476:x1876369722166912:12345-192.168.206.59@tcp:54:lfs.0 Request processed in 438us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446010.024982:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 32 00000100:00100000:1.0:1789446010.027594:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446010.027756:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722167296 00000100:00100000:3.0:1789446010.027778:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722167296 00000100:00100000:3.0:1789446010.027841:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:3.0:1789446010.027853:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+18:14476:x1876369722167296:12345-192.168.206.59@tcp:35:lfs.0 00000100:00100000:3.0:1789446010.028331:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+19:14476:x1876369722167296:12345-192.168.206.59@tcp:35:lfs.0 Request processed in 478us (758us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789446010.028341:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 7 00000040:00080000:1.0:1789446010.203136:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789446010.277910:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446010.278092:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722167552 00000100:00100000:1.0:1789446010.278106:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722167552 00000100:00100000:1.0:1789446010.278189:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 33 00000100:00100000:1.0:1789446010.278203:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+19:14507:x1876369722167552:12345-192.168.206.59@tcp:101:cat.0 00010000:00010000:1.0:1789446010.278240:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446010.278270:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d47257663 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba501c expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.278414:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0400/0xc1b37c4d4725766a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.278436:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0400/0xc1b37c4d4725766a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.278454:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0400/0xc1b37c4d4725766a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446010.278469:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789446010.278671:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d47257663 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba501c expref: 22 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.278698:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0400/0xc1b37c4d4725766a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba501c expref: 21 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.278728:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:1.0:1789446010.278732:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789446010.278739:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd832c0400, rc 0) 00000100:00100000:1.0:1789446010.278849:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+21:14507:x1876369722167552:12345-192.168.206.59@tcp:101:cat.0 Request processed in 649us (959us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789446010.278857:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 33 00000100:00100000:0.0:1789446010.284019:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446010.284127:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446010.284283:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722167680 00000100:00100000:1.0:1789446010.284296:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722167680 00000100:00100000:1.0:1789446010.284391:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 1 00000100:00100000:1.0:1789446010.284413:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a305880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+21:2374:x1876369722167680:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789446010.284437:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446010.284474:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0400/0xc1b37c4d4725766a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba501c expref: 21 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.284497:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:1.0:1789446010.284505:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789446010.284584:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a305880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+20:2374:x1876369722167680:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 183us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446010.284592:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 1 00000100:00100000:3.0:1789446010.285111:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722167936 00000100:00100000:3.0:1789446010.285119:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722167936 00000100:00100000:3.0:1789446010.285161:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 8 00000100:00100000:3.0:1789446010.285183:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+20:14507:x1876369722167936:12345-192.168.206.59@tcp:35:cat.0 00000100:00100000:3.0:1789446010.287128:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+21:14507:x1876369722167936:12345-192.168.206.59@tcp:35:cat.0 Request processed in 1944us (3112us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789446010.287161:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 8 00000100:00100000:0.0:1789446010.372289:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446010.372459:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722168192 00000100:00100000:1.0:1789446010.372477:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722168192 00000100:00100000:1.0:1789446010.372570:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 34 00000100:00100000:1.0:1789446010.372594:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+21:14513:x1876369722168192:12345-192.168.206.59@tcp:101:dd.0 00010000:00010000:1.0:1789446010.372631:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446010.372662:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0400/0xc1b37c4d47257678 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba5023 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.373502:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d4725767f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.373525:0:14359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d4725761d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5000 expref: 22 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.373535:0:14359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257632 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5007 expref: 22 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.373543:0:14359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d4725767f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.373736:0:14359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257632 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5007 expref: 22 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.373756:0:14359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257632 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5007 expref: 22 pid: 14358 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446010.373838:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14359:1876369742078080:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789446010.374025:0:14359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d4725761d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5000 expref: 22 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.374035:0:14359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d4725761d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5000 expref: 22 pid: 14357 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446010.374067:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14359:1876369742078208:192.168.206.59@tcp:104: 00000100:00100000:1.0:1789446010.374115:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789446010.377707:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14359:1876369742078080:192.168.206.59@tcp:104: 00000100:00100000:1.0:1789446010.377733:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14359:1876369742078208:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789446010.377844:0:14359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d4725767f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446010.379893:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446010.380127:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722168320 00000100:00100000:2.0:1789446010.380146:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722168320 00010000:00010000:2.0:1789446010.380210:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257632 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5007 expref: 23 pid: 14358 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446010.380269:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00100000:2.0:1789446010.380282:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+23:2374:x1876369722168320:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789446010.380300:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789446010.380309:0:14342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257632 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5007 expref: 23 pid: 14358 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.380323:0:14342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257632 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5007 expref: 23 pid: 14358 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.380349:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257632 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5007 expref: 23 pid: 14358 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.380369:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:2.0:1789446010.380374:0:14342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d4725767f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.380403:0:14342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d4725767f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.380423:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789446010.380903:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5b01c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+22:2374:x1876369722168320:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 619us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446010.380914:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00100000:2.0:1789446010.384338:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446010.384643:0:16476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722168448 00000100:00100000:1.0:1789446010.384655:0:16476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722168448 00010000:00010000:1.0:1789446010.384711:0:16476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d4725761d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5000 expref: 22 pid: 14357 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446010.384872:0:16476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 12 00000100:00100000:1.0:1789446010.384884:0:16476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+22:2377:x1876369722168448:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789446010.384905:0:16476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446010.384913:0:16476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d4725761d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5000 expref: 22 pid: 14357 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.384929:0:16476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d4725761d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5000 expref: 22 pid: 14357 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.384955:0:16476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d4725761d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5000 expref: 22 pid: 14357 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.384974:0:16476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:1.0:1789446010.384980:0:16476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d4725767f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.385014:0:16476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d4725767f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.385022:0:16476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d4725767f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446010.385093:0:16476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789446010.385251:0:14359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d4725767f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.385260:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d4725767f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789446010.385284:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789446010.385520:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0400/0xc1b37c4d47257678 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5023 expref: 23 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.385542:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1800/0xc1b37c4d4725767f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5023 expref: 22 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.385550:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:2.0:1789446010.385553:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789446010.385555:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd832c1800, rc 0) 00000100:00100000:1.0:1789446010.386078:0:16476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+22:2377:x1876369722168448:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 1194us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446010.386089:0:16476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 12 00000100:00100000:2.0:1789446010.386449:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+21:14513:x1876369722168192:12345-192.168.206.59@tcp:101:dd.0 Request processed in 13857us (14175us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789446010.386458:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 34 00000100:00100000:3.0:1789446010.390698:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446010.390873:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722168704 00000100:00100000:2.0:1789446010.390906:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722168704 00000100:00100000:2.0:1789446010.391017:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 35 00000100:00100000:2.0:1789446010.391031:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+21:14513:x1876369722168704:12345-192.168.206.59@tcp:36:dd.0 00010000:00010000:2.0:1789446010.391485:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d4725768d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.391512:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d4725768d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.391528:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d4725768d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789446010.391604:0:14357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789446010.391654:0:14357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004827cef7 reply state 000000000b6ee1f8 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d4725768d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446010.391666:0:14357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789446010.391979:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+24:14513:x1876369722168704:12345-192.168.206.59@tcp:36:dd.0 Request processed in 949us (1297us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789446010.391988:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 35 00000020:00080000:2.0:1789446010.391995:0:14357:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789446010.394799:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446010.395390:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722168832 00000100:00100000:2.0:1789446010.395407:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722168832 00000100:00100000:2.0:1789446010.395489:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 36 00000100:00100000:2.0:1789446010.395502:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+24:14513:x1876369722168832:12345-192.168.206.59@tcp:101:dd.0 00010000:00010000:2.0:1789446010.395535:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446010.395560:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5000/0xc1b37c4d47257694 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba502a expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.395649:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5000/0xc1b37c4d47257694 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba502a expref: 25 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.395684:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5000/0xc1b37c4d47257694 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba502a expref: 25 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.395709:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:2.0:1789446010.395712:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789446010.395718:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeba8f5000, rc 0) 00000100:00100000:2.0:1789446010.395875:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+25:14513:x1876369722168832:12345-192.168.206.59@tcp:101:dd.0 Request processed in 374us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446010.395883:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 36 00010000:00010000:3.0:1789446010.396096:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d4725768d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446010.396110:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d4725768d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446010.396118:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d4725768d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446010.396126:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f4400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789446010.396132:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d4725768d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446010.396146:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d4725768d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446010.396161:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:3.0:1789446010.396165:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789446010.396169:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d4725768d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446010.396176:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d4725768d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446010.407796:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446010.407847:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446010.407878:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446010.407906:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446010.407962:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446010.408002:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722169088 00000100:00100000:2.0:1789446010.408099:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722169216 00000100:00100000:2.0:1789446010.408119:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722169216 00000100:00100000:2.0:1789446010.408192:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722169472 00000100:00100000:2.0:1789446010.408196:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722169472 00000100:00100000:2.0:1789446010.408210:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722169344 00000100:00100000:2.0:1789446010.408212:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722169344 00000100:00100000:2.0:1789446010.408230:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00100000:2.0:1789446010.408240:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+5:2377:x1876369722169216:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789446010.408326:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+5:2377:x1876369722169216:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 87us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446010.408334:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00100000:2.0:1789446010.408351:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:2.0:1789446010.408357:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5773df71-2069-48bb-a13d-12dd45acbeba+5:2377:x1876369722169472:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789446010.408379:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5773df71-2069-48bb-a13d-12dd45acbeba+5:2377:x1876369722169472:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 22us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446010.408384:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:2.0:1789446010.408401:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00100000:2.0:1789446010.408407:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5773df71-2069-48bb-a13d-12dd45acbeba+5:2377:x1876369722169344:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789446010.408429:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5773df71-2069-48bb-a13d-12dd45acbeba+5:2377:x1876369722169344:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 22us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446010.408434:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00080000:2.0:1789446010.408452:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789446010.408457:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789446010.409376:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722169088 00000100:00100000:1.0:1789446010.409490:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722168960 00000100:00100000:1.0:1789446010.409495:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722168960 00000100:00100000:1.0:1789446010.409552:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 124 00000100:00100000:1.0:1789446010.409561:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f97e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:2377:x1876369722168960:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:1.0:1789446010.409632:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f97e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0da5c432-b9e3-4d15-b46a-529046cbdbfd+13:2377:x1876369722168960:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 73us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446010.409639:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 124 00000100:00100000:3.0:1789446010.411444:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446010.411699:0:16477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722169728 00000100:00100000:0.0:1789446010.411710:0:16477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722169728 00000100:00100000:0.0:1789446010.411799:0:16477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 2 00000100:00100000:0.0:1789446010.411810:0:16477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+24:14513:x1876369722169728:12345-192.168.206.59@tcp:103:dd.0 00010000:00010000:0.0:1789446010.411835:0:16477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789446010.411891:0:16477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5000/0xc1b37c4d47257694 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba502a expref: 24 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446010.411917:0:16477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:0.0:1789446010.411924:0:16477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789446010.411932:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 12 00000100:00100000:2.0:1789446010.411940:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+5:2377:x1876369722169088:12345-192.168.206.59@tcp:400:kworker.0 00000100:00100000:2.0:1789446010.411982:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+5:2377:x1876369722169088:12345-192.168.206.59@tcp:400:kworker.0 Request processed in 43us (4135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446010.411991:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 12 00000100:00080000:3.0:1789446010.412066:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789446010.412294:0:16477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+23:14513:x1876369722169728:12345-192.168.206.59@tcp:103:dd.0 Request processed in 485us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446010.412301:0:16477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 2 00000100:00100000:0.0:1789446010.414360:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446010.414511:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722169856 00000100:00100000:2.0:1789446010.414523:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722169856 00000100:00100000:2.0:1789446010.414637:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 37 00000100:00100000:2.0:1789446010.414648:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+23:14513:x1876369722169856:12345-192.168.206.59@tcp:58:dd.0 00010000:00010000:2.0:1789446010.414880:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5400/0xc1b37c4d4725769b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.414901:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5400/0xc1b37c4d4725769b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.414916:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5400/0xc1b37c4d4725769b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789446010.416542:0:14357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789446010.416863:0:14357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789446010.416953:0:14357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789446010.417820:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+23:14513:x1876369722169856:12345-192.168.206.59@tcp:58:dd.0 Request processed in 3163us (3462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446010.417837:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 37 00000100:00100000:1.0:1789446010.421481:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446010.421639:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722169984 00000100:00100000:2.0:1789446010.421651:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722169984 00000100:00100000:2.0:1789446010.421724:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 38 00000100:00100000:2.0:1789446010.421736:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+23:14513:x1876369722169984:12345-192.168.206.59@tcp:101:dd.0 00010000:00010000:2.0:1789446010.421867:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446010.421896:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4800/0xc1b37c4d472576a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba5031 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.421982:0:14358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5400/0xc1b37c4d4725769b lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.421995:0:14358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4800/0xc1b37c4d472576a2 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5031 expref: 24 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.422018:0:14358:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5400/0xc1b37c4d4725769b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.422033:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4800/0xc1b37c4d472576a2 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5031 expref: 24 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.422263:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:2.0:1789446010.422268:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789446010.422274:0:14358:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4800/0xc1b37c4d472576a2 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5031 expref: 24 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446010.422283:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeba8f4800, rc 0) 00000100:00100000:2.0:1789446010.422366:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+24:14513:x1876369722169984:12345-192.168.206.59@tcp:101:dd.0 Request processed in 632us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446010.422373:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 38 00010000:00010000:0.0:1789446010.970392:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789446011.226555:0:14391:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789446011.226570:0:14391:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789446011.226688:0:14391:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789446011.226698:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789446011.226886:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14391:1876369742078336:192.168.206.59@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789446011.228332:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789446011.232211:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14391:1876369742078336:192.168.206.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789446011.232951:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446011.234162:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722170112 00000100:00100000:3.0:1789446011.234177:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722170112 00000100:00100000:3.0:1789446011.234281:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 0 00000100:00100000:3.0:1789446011.234302:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+24:14514:x1876369722170112:12345-192.168.206.59@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789446011.234431:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+24:14514:x1876369722170112:12345-192.168.206.59@tcp:900:lhsmtool_posix.0 Request processed in 138us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446011.234440:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 0 00000100:00080000:2.0:1789446011.235773:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789446011.238550:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446011.238789:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722170240 00000100:00100000:2.0:1789446011.238803:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722170240 00000100:00100000:2.0:1789446011.238916:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 39 00000100:00100000:2.0:1789446011.238928:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+24:14514:x1876369722170240:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789446011.238994:0:14357:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789446011.239177:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+24:14514:x1876369722170240:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 Request processed in 252us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446011.239186:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 39 00000100:00100000:0.0:1789446011.242541:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446011.243304:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722170368 00000100:00100000:1.0:1789446011.243320:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722170368 00000100:00100000:2.0:1789446011.243473:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 40 00000100:00100000:2.0:1789446011.243490:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+24:14514:x1876369722170368:12345-192.168.206.59@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789446011.243587:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4600/0xc1b37c4d472576a9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.243614:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4600/0xc1b37c4d472576a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.243630:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4600/0xc1b37c4d472576a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.243870:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d472576b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.244644:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d472576b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.244672:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d472576b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.244709:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4e00/0xc1b37c4d472576b7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.244719:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4e00/0xc1b37c4d472576b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.244726:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4e00/0xc1b37c4d472576b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789446011.244789:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789446011.244794:0:14359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789446011.244829:0:14359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4e00/0xc1b37c4d472576b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.244843:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4600/0xc1b37c4d472576a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.244850:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4600/0xc1b37c4d472576a9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.244858:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4600/0xc1b37c4d472576a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.244864:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f4600 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789446011.244869:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4600/0xc1b37c4d472576a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.244888:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4600/0xc1b37c4d472576a9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.246025:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afe88661400) 00010000:00010000:2.0:1789446011.246032:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789446011.246040:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4600/0xc1b37c4d472576a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.246063:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4600/0xc1b37c4d472576a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.246082:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d472576b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.246090:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d472576b0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.246097:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d472576b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.246103:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f4400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789446011.246107:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d472576b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.246119:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d472576b0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.246980:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9afe82ec9b00) 00010000:00010000:2.0:1789446011.246986:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789446011.246992:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d472576b0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.246999:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4400/0xc1b37c4d472576b0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.247038:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4e00/0xc1b37c4d472576b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.247094:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4e00/0xc1b37c4d472576b7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.247101:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4e00/0xc1b37c4d472576b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.247108:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f4e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789446011.247112:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4e00/0xc1b37c4d472576b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.247118:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4e00/0xc1b37c4d472576b7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.247987:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:2.0:1789446011.247994:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789446011.247999:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4e00/0xc1b37c4d472576b7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.248007:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4e00/0xc1b37c4d472576b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446011.248142:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+24:14514:x1876369722170368:12345-192.168.206.59@tcp:34:lhsmtool_posix.0 Request processed in 4643us (5600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446011.248153:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 40 00000100:00100000:0.0:1789446011.252437:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446011.254026:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722170624 00000100:00100000:3.0:1789446011.254039:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722170624 00000100:00100000:3.0:1789446011.254143:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 41 00000100:00100000:3.0:1789446011.254155:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+24:14514:x1876369722170624:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789446011.254174:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446011.254193:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d472576be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba5038 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.254292:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988a00/0xc1b37c4d472576c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.254309:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988a00/0xc1b37c4d472576c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.254322:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988a00/0xc1b37c4d472576c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789446011.254352:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789446011.254457:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988a00/0xc1b37c4d472576c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.254465:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988a00/0xc1b37c4d472576c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.254470:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988a00/0xc1b37c4d472576c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.254476:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e988a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789446011.254479:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988a00/0xc1b37c4d472576c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.254487:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988a00/0xc1b37c4d472576c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.254498:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:3.0:1789446011.254501:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789446011.254515:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988a00/0xc1b37c4d472576c5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.254522:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988a00/0xc1b37c4d472576c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.254566:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d472576be lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5038 expref: 26 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.254575:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afe88661400) 00010000:00010000:3.0:1789446011.254577:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789446011.254587:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d472576be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5038 expref: 26 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.254596:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e989c00, rc 0) 00000100:00100000:3.0:1789446011.255486:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+25:14514:x1876369722170624:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 1329us (3052us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1789446011.255495:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 41 00000100:00100000:1.0:1789446011.266353:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446011.267686:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722170752 00000100:00100000:2.0:1789446011.267698:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722170752 00000100:00100000:3.0:1789446011.275185:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 42 00000100:00100000:3.0:1789446011.275198:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+25:14514:x1876369722170752:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789446011.275231:0:14359:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789446011.275331:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+25:14514:x1876369722170752:12345-192.168.206.59@tcp:53:lhsmtool_posix.0 Request processed in 135us (8987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446011.275338:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 42 00000100:00100000:1.0:1789446011.278558:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446011.278794:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722171008 00000100:00100000:3.0:1789446011.278803:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722171008 00000100:00100000:3.0:1789446011.278854:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 43 00000100:00100000:3.0:1789446011.278864:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+25:14514:x1876369722171008:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789446011.278893:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446011.279200:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d472576d3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba503f expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789446011.280597:0:14357:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1789446011.280606:0:14357:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1789446011.280663:0:14357:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1789446011.281273:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988a00/0xc1b37c4d472576da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.281301:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988a00/0xc1b37c4d472576da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.281312:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988a00/0xc1b37c4d472576da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.281379:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e989c00/0xc1b37c4d472576d3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba503f expref: 28 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.281396:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988a00/0xc1b37c4d472576da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba503f expref: 27 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.281418:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afe8e97aa00) 00010000:00010000:3.0:1789446011.281422:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789446011.281425:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e988a00, rc 0) 00000100:00100000:3.0:1789446011.281494:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+27:14514:x1876369722171008:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 2630us (2942us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1789446011.281511:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 43 00000100:00100000:0.0:1789446011.285149:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446011.285290:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722171264 00000100:00100000:1.0:1789446011.285300:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722171264 00000100:00100000:1.0:1789446011.285352:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 44 00000100:00100000:1.0:1789446011.285362:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+27:14514:x1876369722171264:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789446011.285424:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446011.285448:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988a00/0xc1b37c4d472576da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba503f expref: 27 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285465:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afe8e97aa00) 00010000:00010000:1.0:1789446011.285474:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789446011.285495:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d472576e8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285518:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d472576e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285529:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d472576e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285543:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d472576ef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x8d2aa3ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285550:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d472576ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d2aa3ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285557:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d472576ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d2aa3ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285610:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d472576e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285630:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d472576e8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285638:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d472576e8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285644:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c1c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789446011.285648:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d472576e8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285657:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d472576e8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285665:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afe98961200) 00010000:00010000:1.0:1789446011.285668:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446011.285673:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d472576e8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285679:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d472576e8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285689:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d472576ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d2aa3ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285695:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d472576ef lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d2aa3ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285702:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d472576ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d2aa3ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285707:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:1.0:1789446011.285715:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d472576ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d2aa3ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285722:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d472576ef lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8d2aa3ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285729:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x8d2aa3ef (ffff9afe88661a00) 00010000:00010000:1.0:1789446011.285732:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446011.285735:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d472576ef lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x8d2aa3ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.285742:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d472576ef lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x8d2aa3ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446011.286316:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+26:14514:x1876369722171264:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 Request processed in 952us (1171us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789446011.286324:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 44 00000100:00100000:1.0:1789446011.290464:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446011.290668:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722171392 00000100:00100000:3.0:1789446011.290679:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722171392 00000100:00100000:3.0:1789446011.290739:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 45 00000100:00100000:3.0:1789446011.290750:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+26:14514:x1876369722171392:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789446011.290778:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446011.290801:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988600/0xc1b37c4d472576f6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba5046 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.290837:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988200/0xc1b37c4d472576fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.290863:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988200/0xc1b37c4d472576fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.290875:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988200/0xc1b37c4d472576fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.290980:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988600/0xc1b37c4d472576f6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5046 expref: 28 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.290999:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988200/0xc1b37c4d472576fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5046 expref: 27 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.291006:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afe8e97a900) 00010000:00010000:3.0:1789446011.291009:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789446011.291012:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e988200, rc 0) 00000100:00100000:3.0:1789446011.291105:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+27:14514:x1876369722171392:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 356us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446011.291113:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 45 00000100:00100000:2.0:1789446011.294244:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446011.294316:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722171648 00000100:00100000:1.0:1789446011.294330:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722171648 00000100:00100000:1.0:1789446011.294409:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 46 00000100:00100000:1.0:1789446011.294419:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+27:14514:x1876369722171648:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789446011.294489:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d47257704 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.294516:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d47257704 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.294529:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d47257704 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789446011.295304:0:14358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1789446011.295317:0:14358:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 449317271289ns, next at 450317269131ns, rc = 0 00000004:00010000:1.0:1789446011.296121:0:14358:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e31b070c reply state 00000000502865ee transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d47257704 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446011.299743:0:14358:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789446011.300102:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+29:14514:x1876369722171648:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 Request processed in 5681us (5867us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789446011.300113:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 46 00010000:00010000:2.0:1789446011.305098:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d47257704 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.305121:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d47257704 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.305129:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d47257704 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.305135:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0800 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789446011.305141:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d47257704 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.305149:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d47257704 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.305169:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afe8e97a900) 00010000:00010000:2.0:1789446011.305172:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789446011.305179:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d47257704 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.305185:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0800/0xc1b37c4d47257704 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446011.306394:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446011.306529:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722171776 00000100:00100000:3.0:1789446011.306542:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722171776 00000100:00100000:3.0:1789446011.306755:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 47 00000100:00100000:3.0:1789446011.306778:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+28:14514:x1876369722171776:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789446011.306810:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446011.306836:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988600/0xc1b37c4d4725770b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba504d expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.307816:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988600/0xc1b37c4d4725770b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba504d expref: 29 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.307840:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988600/0xc1b37c4d4725770b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba504d expref: 29 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.307867:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afe8e97a900) 00010000:00010000:2.0:1789446011.307889:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789446011.307894:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afe8e988600, rc 0) 00000100:00100000:2.0:1789446011.308397:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+29:14514:x1876369722171776:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 1620us (2010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446011.308406:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 47 00000100:00100000:0.0:1789446011.313926:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446011.314153:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722171904 00000100:00100000:2.0:1789446011.314165:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722171904 00000100:00100000:2.0:1789446011.314287:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00100000:2.0:1789446011.314301:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe8a307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+5:2377:x1876369722171904:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789446011.315001:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe8a307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+6:2377:x1876369722171904:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 Request processed in 700us (1088us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789446011.315010:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00100000:0.0:1789446011.318820:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446011.318941:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722172160 00000100:00100000:1.0:1789446011.318953:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722172160 00000100:00100000:1.0:1789446011.319028:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00100000:1.0:1789446011.319041:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+29:14514:x1876369722172160:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789446011.319387:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+30:14514:x1876369722172160:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 Request processed in 349us (581us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1789446011.319393:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 9 00000100:00100000:3.0:1789446011.324605:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446011.326783:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722172416 00000100:00100000:1.0:1789446011.326805:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722172416 00000100:00100000:1.0:1789446011.326922:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 48 00000100:00100000:1.0:1789446011.326936:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+30:14514:x1876369722172416:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789446011.327155:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+30:14514:x1876369722172416:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 Request processed in 222us (2566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446011.327164:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 48 00000100:00100000:2.0:1789446011.329343:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446011.329435:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722172544 00000100:00100000:0.0:1789446011.329445:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722172544 00000100:00100000:0.0:1789446011.329550:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 49 00000100:00100000:0.0:1789446011.329561:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+30:14514:x1876369722172544:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789446011.329596:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789446011.329622:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aacc00/0xc1b37c4d47257712 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba5054 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446011.329708:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad400/0xc1b37c4d47257719 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446011.329725:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad400/0xc1b37c4d47257719 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446011.329754:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad400/0xc1b37c4d47257719 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789446011.329812:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789446011.329837:0:14357:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad400/0xc1b37c4d47257719 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446011.329865:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aacc00/0xc1b37c4d47257712 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5054 expref: 32 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446011.329885:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad400/0xc1b37c4d47257719 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5054 expref: 31 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446011.329894:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afe8e97a900) 00010000:00010000:0.0:1789446011.329898:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789446011.329903:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeb6aad400, rc 0) 00000100:00100000:0.0:1789446011.329969:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+31:14514:x1876369722172544:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 410us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446011.329976:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 49 00000100:00100000:0.0:1789446011.333029:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446011.333157:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722172672 00000100:00100000:2.0:1789446011.333169:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722172672 00000100:00100000:2.0:1789446011.333239:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 12 00000100:00100000:2.0:1789446011.333250:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+6:2374:x1876369722172672:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789446011.333271:0:15043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446011.333296:0:15043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f286b9c4/0xc1b37c4d47257720 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba505b expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789446011.333334:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa8c77b, blocks: 0x1 00010000:00010000:2.0:1789446011.333357:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1789446011.333363:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446011.333374:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f286b9c4/0xc1b37c4d47257720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba505b expref: 7 pid: 15043 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.333424:0:15043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f286b9c4/0xc1b37c4d47257720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba505b expref: 7 pid: 15043 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.333440:0:15043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afeba8f4400, rc 0) 00000100:00100000:2.0:1789446011.333510:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+7:2374:x1876369722172672:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 261us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446011.333517:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 12 00000100:00100000:3.0:1789446011.335169:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446011.335336:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722172928 00000100:00100000:1.0:1789446011.335346:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722172928 00000100:00100000:1.0:1789446011.335455:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 50 00000100:00100000:1.0:1789446011.335466:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+31:14514:x1876369722172928:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789446011.335564:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+31:14514:x1876369722172928:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 Request processed in 102us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446011.335570:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 50 00000100:00100000:0.0:1789446011.338353:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446011.339911:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722173056 00000100:00100000:2.0:1789446011.339994:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722173056 00000100:00100000:2.0:1789446011.340132:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 51 00000100:00100000:2.0:1789446011.340145:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+31:14514:x1876369722173056:12345-192.168.206.59@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789446011.380990:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934603 is committed 00000001:00080000:2.0:1789446011.381010:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1789446011.381019:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1789446011.381026:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789446011.381094:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1789446011.381484:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+14:14514:x1876369722173056:12345-192.168.206.59@tcp:44:lhsmtool_posix.0 Request processed in 41337us (43140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446011.381496:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 51 00000100:00100000:2.0:1789446011.381831:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afd81215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742078464:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789446011.381882:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446011.382153:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742078464 00000100:00100000:3.0:1789446011.382161:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742078464 00000100:00100000:3.0:1789446011.382225:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789446011.382235:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876369742078464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789446011.382389:0:15044:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789446011.382393:0:15044:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789446011.382395:0:15044:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789446011.382397:0:15044:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789446011 -> 1789446011 00002000:00010000:3.0:1789446011.382400:0:15044:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789446011.382435:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1876369742078464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 202us (553us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1789446011.382442:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789446011.382600:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789446011.382646:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afd81215880/2, rc 0, transno 8589934595 00000100:00100000:2.0:1789446011.382654:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afd81215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876369742078464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789446011.392219:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446011.392424:0:16432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722173184 00000100:00100000:2.0:1789446011.392436:0:16432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722173184 00000100:00100000:2.0:1789446011.392498:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 14 00000100:00100000:2.0:1789446011.392507:0:16432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+7:2375:x1876369722173184:12345-192.168.206.59@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789446011.392813:0:16432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+7:2375:x1876369722173184:12345-192.168.206.59@tcp:16:lhsmtool_posix.0 Request processed in 305us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446011.392822:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 14 00000100:00100000:0.0:1789446011.397423:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446011.397528:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722173440 00000100:00100000:1.0:1789446011.397538:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722173440 00000100:00100000:1.0:1789446011.397601:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 52 00000100:00100000:1.0:1789446011.397622:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+14:14514:x1876369722173440:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789446011.397677:0:14359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446011.397705:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeb6aad400/0xc1b37c4d47257719 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5054 expref: 14 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.397726:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afe8e97a900) 00010000:00010000:1.0:1789446011.397731:0:14359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789446011.397770:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d47257727 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.397783:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d47257727 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.397794:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d47257727 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789446011.397968:0:14359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e7a6311 reply state 000000003a77da11 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d47257727 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446011.397977:0:14359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789446011.398126:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+15:14514:x1876369722173440:12345-192.168.206.59@tcp:36:lhsmtool_posix.0 Request processed in 505us (712us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1789446011.398133:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 52 00000100:00100000:0.0:1789446011.401224:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446011.401419:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722173568 00000100:00100000:1.0:1789446011.401429:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722173568 00010000:00010000:3.0:1789446011.401454:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d47257727 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.401473:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d47257727 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.401482:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d47257727 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.401490:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c1c00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:3.0:1789446011.401496:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d47257727 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.401504:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d47257727 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.401523:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afe8e97a900) 00010000:00010000:3.0:1789446011.401546:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789446011.401553:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d47257727 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.401561:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c1c00/0xc1b37c4d47257727 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446011.401597:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 15 00000100:00100000:1.0:1789446011.401621:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+7:14514:x1876369722173568:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789446011.401639:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446011.401656:0:15044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725772e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf8a378b6cba5062 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.401687:0:15044:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f286b9c4/0xc1b37c4d47257720 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba505b expref: 8 pid: 15043 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.401696:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446011.401700:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446011.401705:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725772e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5062 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.401738:0:15044:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f286b9c4/0xc1b37c4d47257720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba505b expref: 8 pid: 15043 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.401751:0:15044:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f286b9c4/0xc1b37c4d47257720 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba505b expref: 8 pid: 15043 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446011.401777:0:15044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15044:1876369742078592:192.168.206.59@tcp:104: 00000100:00100000:1.0:1789446011.401876:0:15044:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789446011.405457:0:15044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15044:1876369742078592:192.168.206.59@tcp:104: 00010000:00010000:1.0:1789446011.405495:0:15044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725772e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5062 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.405615:0:15044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd832c0400, rc 0) 00000100:00100000:1.0:1789446011.405725:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+8:14514:x1876369722173568:12345-192.168.206.59@tcp:101:lhsmtool_posix.0 Request processed in 4115us (4507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446011.405733:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 15 00000100:00100000:0.0:1789446011.409475:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446011.411799:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722173696 00000100:00100000:1.0:1789446011.411813:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722173696 00010000:00010000:1.0:1789446011.411865:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f286b9c4/0xc1b37c4d47257720 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba505b expref: 8 pid: 15043 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446011.411918:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 13 00000100:00100000:1.0:1789446011.411928:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+8:2375:x1876369722173696:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789446011.411944:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446011.411966:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f286b9c4/0xc1b37c4d47257720 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba505b expref: 8 pid: 15043 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.411980:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f286b9c4/0xc1b37c4d47257720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba505b expref: 8 pid: 15043 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.412002:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f286b9c4/0xc1b37c4d47257720 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba505b expref: 8 pid: 15043 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.412036:0:14344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446011.412040:0:14344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446011.412676:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725772e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5062 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.412689:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725772e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5062 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.412738:0:14344:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725772e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5062 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446011.412752:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebffc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14344:1876369742078720:192.168.206.59@tcp:105: 00000100:00100000:1.0:1789446011.412851:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea48b3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789446011.418065:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446011.418486:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722173824 00000100:00100000:2.0:1789446011.418496:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722173824 00000100:00100000:2.0:1789446011.418552:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 16 00000100:00100000:2.0:1789446011.418563:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+8:2374:x1876369722173824:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789446011.418794:0:15043:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789446011.418799:0:15043:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789446010 00002000:00010000:2.0:1789446011.418801:0:15043:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789446009 00002000:00010000:2.0:1789446011.418804:0:15043:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789446011 -> 1789446010 00002000:00010000:2.0:1789446011.418806:0:15043:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789446011.418870:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+9:2374:x1876369722173824:12345-192.168.206.59@tcp:2:lhsmtool_posix.0 Request processed in 309us (829us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789446011.418878:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 16 00000100:00100000:1.0:1789446011.419698:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebffc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14344:1876369742078720:192.168.206.59@tcp:105: 00010000:00010000:1.0:1789446011.419720:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789446011.419888:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+8:2375:x1876369722173696:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 7961us (10423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446011.419897:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 13 00000100:00100000:0.0:1789446011.423214:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446011.424602:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722173952 00000100:00100000:2.0:1789446011.424614:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722173952 00000100:00100000:2.0:1789446011.424734:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 17 00000100:00100000:2.0:1789446011.424745:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+8:2375:x1876369722173952:12345-192.168.206.59@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789446011.424982:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b3f4612/0xc1b37c4d47257735 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.425002:0:15042:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725772e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5062 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.425011:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446011.425016:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789446011.425020:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b3f4612/0xc1b37c4d47257735 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.425117:0:15042:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725772e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5062 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.425132:0:15042:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725772e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5062 expref: 8 pid: 15044 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446011.425147:0:15042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9f1c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15042:1876369742078848:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789446011.425286:0:15042:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4ebe780 going to sleep for 11 seconds 00000100:00100000:0.0:1789446011.430484:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446011.430592:0:16476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722174080 00000100:00100000:1.0:1789446011.430603:0:16476:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722174080 00010000:00010000:1.0:1789446011.430650:0:16476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725772e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5062 expref: 9 pid: 15044 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446011.430710:0:16476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 14 00000100:00100000:1.0:1789446011.430721:0:16476:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+9:2374:x1876369722174080:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789446011.430737:0:16476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446011.430789:0:16476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725772e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5062 expref: 9 pid: 15044 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.430804:0:16476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725772e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5062 expref: 9 pid: 15044 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.430830:0:16476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789446011.430835:0:16476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789446011.430841:0:16476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b3f4612/0xc1b37c4d47257735 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.430851:0:16476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b3f4612/0xc1b37c4d47257735 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.430874:0:16476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789446011.430937:0:16476:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+9:2374:x1876369722174080:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 216us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446011.430944:0:16476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 14 00010000:00010000:2.0:1789446011.431040:0:15042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004d00125/0xc1b37c4d4725772e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5062 expref: 8 pid: 15044 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446011.431083:0:15042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9f1c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15042:1876369742078848:192.168.206.59@tcp:104: 00010000:00010000:2.0:1789446011.431102:0:15042:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b3f4612/0xc1b37c4d47257735 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.431124:0:15042:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b3f4612/0xc1b37c4d47257735 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.431131:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b3f4612/0xc1b37c4d47257735 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.431154:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b3f4612/0xc1b37c4d47257735 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.431162:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b3f4612/0xc1b37c4d47257735 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.431170:0:15042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b3f4612/0xc1b37c4d47257735 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.431177:0:15042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f4600 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789446011.431181:0:15042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b3f4612/0xc1b37c4d47257735 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.431189:0:15042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b3f4612/0xc1b37c4d47257735 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.431201:0:15042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b3f4612/0xc1b37c4d47257735 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.431219:0:15042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b3f4612/0xc1b37c4d47257735 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446011.431262:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+7:2375:x1876369722173952:12345-192.168.206.59@tcp:1:lhsmtool_posix.0 Request processed in 6519us (8059us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446011.431270:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 17 00000100:00100000:3.0:1789446011.435341:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446011.435426:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722174336 00000100:00100000:2.0:1789446011.435436:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722174336 00000100:00100000:2.0:1789446011.435490:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 53 00000100:00100000:2.0:1789446011.435500:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd81215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+14:14514:x1876369722174336:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789446011.435578:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5e00/0xc1b37c4d4725773c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.435595:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5e00/0xc1b37c4d4725773c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.435606:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5e00/0xc1b37c4d4725773c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.435885:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d47257743 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.435898:0:14357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988600/0xc1b37c4d4725770b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba504d expref: 15 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.435907:0:14357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d47257743 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.435947:0:14357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988600/0xc1b37c4d4725770b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba504d expref: 15 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.435961:0:14357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988600/0xc1b37c4d4725770b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba504d expref: 15 pid: 14357 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446011.435973:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9f1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14357:1876369742078976:192.168.206.59@tcp:104: 00000100:00100000:2.0:1789446011.436103:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afea4ebe780 going to sleep for 11 seconds 00000100:00100000:0.0:1789446011.439345:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446011.439512:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9f1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14357:1876369742078976:192.168.206.59@tcp:104: 00010000:00010000:3.0:1789446011.439538:0:14357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d47257743 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446011.439585:0:16477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722174464 00000100:00100000:1.0:1789446011.439593:0:16477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722174464 00010000:00010000:1.0:1789446011.439629:0:16477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988600/0xc1b37c4d4725770b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba504d expref: 16 pid: 14357 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446011.439696:0:16477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 15 00000100:00100000:1.0:1789446011.439706:0:16477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+16:2375:x1876369722174464:12345-192.168.206.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789446011.439724:0:16477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446011.439731:0:16477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988600/0xc1b37c4d4725770b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba504d expref: 16 pid: 14357 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.439771:0:16477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988600/0xc1b37c4d4725770b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba504d expref: 16 pid: 14357 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.439795:0:16477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afe8e988600/0xc1b37c4d4725770b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba504d expref: 16 pid: 14357 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.439813:0:16477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afe8e97a900) 00010000:00010000:1.0:1789446011.439817:0:16477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d47257743 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.439828:0:16477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d47257743 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.439836:0:16477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d47257743 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.439870:0:16477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789446011.439937:0:16477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+15:2375:x1876369722174464:12345-192.168.206.59@tcp:103:ldlm_bl.0 Request processed in 231us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446011.439944:0:16477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 15 00010000:00010000:2.0:1789446011.439993:0:14357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d47257743 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.440001:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d47257743 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789446011.440207:0:14357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789446011.440347:0:14357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789446011.440395:0:14357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789446011.440467:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9f1ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14357:1876369742079104:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789446011.440559:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446011.440590:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8513fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789446011.440623:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742079104 00000100:00100000:2.0:1789446011.440629:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742079104 00000100:00100000:2.0:1789446011.440657:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789446011.440664:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14357:x1876369742079104:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789446011.440734:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14357:x1876369742079104:12345-0@lo:1000:mdt00_000.0 Request processed in 71us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446011.440740:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789446011.440794:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9f1ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14357:1876369742079104:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789446011.441423:0:14357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1789446011.441474:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9f1ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14357:1876369742079232:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789446011.441503:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446011.441530:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8513f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789446011.441615:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742079232 00000100:00100000:0.0:1789446011.441620:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742079232 00000100:00100000:0.0:1789446011.441643:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789446011.441650:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14357:x1876369742079232:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789446011.441802:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14357:x1876369742079232:12345-0@lo:1000:mdt00_000.0 Request processed in 152us (296us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789446011.441809:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789446011.442767:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9f1ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14357:1876369742079232:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789446011.442815:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d47257743 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.442825:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d47257743 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.442833:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d47257743 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.442840:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f5a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789446011.442845:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d47257743 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.442854:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d47257743 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.442870:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afe8e97a900) 00010000:00010000:2.0:1789446011.442873:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789446011.442878:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d47257743 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.442885:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d47257743 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.442920:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5400/0xc1b37c4d4725769b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.442943:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5400/0xc1b37c4d4725769b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.442949:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5400/0xc1b37c4d4725769b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.442954:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f5400 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789446011.442957:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5400/0xc1b37c4d4725769b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.442963:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5400/0xc1b37c4d4725769b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.442972:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:2.0:1789446011.442974:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789446011.442980:0:14357:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4800/0xc1b37c4d472576a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5031 expref: 18 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.442990:0:14357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4800/0xc1b37c4d472576a2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5031 expref: 18 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.442998:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4800/0xc1b37c4d472576a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5031 expref: 18 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.443031:0:14357:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f4800/0xc1b37c4d472576a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.59@tcp remote: 0xaf8a378b6cba5031 expref: 18 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446011.443065:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afeb9f1fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14357:1876369742079360:192.168.206.59@tcp:105: 00000100:00100000:2.0:1789446011.443261:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9afe8513f840 going to sleep for 11 seconds 00000100:00100000:2.0:1789446011.453925:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afeb9f1fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14357:1876369742079360:192.168.206.59@tcp:105: 00010000:00010000:2.0:1789446011.453957:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5400/0xc1b37c4d4725769b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.453968:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5400/0xc1b37c4d4725769b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.454001:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d4725774a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.454019:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d4725774a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.454031:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d4725774a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.454074:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d4725774a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.454083:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d4725774a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.454090:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d4725774a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.454096:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f5a00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789446011.454101:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d4725774a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.454109:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d4725774a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.454153:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:2.0:1789446011.454156:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789446011.454160:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d4725774a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.454167:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5a00/0xc1b37c4d4725774a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.454177:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5e00/0xc1b37c4d4725773c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.454183:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5e00/0xc1b37c4d4725773c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.454189:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5e00/0xc1b37c4d4725773c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.454194:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f5e00 already unused, calling callback (ffffffffc21c04f0) 00010000:00010000:2.0:1789446011.454196:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5e00/0xc1b37c4d4725773c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.454201:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5e00/0xc1b37c4d4725773c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.454207:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afe88661200) 00010000:00010000:2.0:1789446011.454210:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789446011.454213:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5e00/0xc1b37c4d4725773c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.454218:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afeba8f5e00/0xc1b37c4d4725773c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446011.454454:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd81215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+18:14514:x1876369722174336:12345-192.168.206.59@tcp:57:lhsmtool_posix.0 Request processed in 18953us (19120us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789446011.454465:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 53 00000020:00080000:2.0:1789446011.454472:0:14357:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789446011.455867:0:14391:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789446011.455888:0:14391:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789446011.455919:0:14391:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789446011.455924:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789446011.456413:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446011.456508:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722174592 00000100:00100000:3.0:1789446011.456516:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722174592 00000100:00100000:3.0:1789446011.456589:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:3.0:1789446011.456599:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe91916450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+18:14513:x1876369722174592:12345-192.168.206.59@tcp:49:dd.0 00000100:00100000:3.0:1789446011.456779:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe91916450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+18:14513:x1876369722174592:12345-192.168.206.59@tcp:49:dd.0 Request processed in 180us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446011.456786:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 10 00000100:00100000:0.0:1789446011.459972:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446011.461661:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722174848 00000100:00100000:1.0:1789446011.461679:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722174848 00000100:00100000:1.0:1789446011.461774:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 11 00000100:00100000:1.0:1789446011.461788:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+18:14514:x1876369722174848:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789446011.462864:0:14360:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789446011.462975:0:14360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1789446011.463036:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257751 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.464807:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257751 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.464827:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257751 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.464839:0:14360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257751 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.464846:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257751 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.464852:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257751 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.464883:0:14360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789446011.465086:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+20:14514:x1876369722174848:12345-192.168.206.59@tcp:35:lhsmtool_posix.0 Request processed in 3258us (5085us total) trans 8589934622 rc 0/0 00010000:00010000:2.0:1789446011.465635:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789446011.465644:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 11 00010000:00010000:2.0:1789446011.465653:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257751 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789446011.465656:0:14360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789446011.465670:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0200 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789446011.465677:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257751 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.465688:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257751 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.465711:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afe8e97a900) 00010000:00010000:2.0:1789446011.465716:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789446011.465722:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257751 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.465728:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd832c0200/0xc1b37c4d47257751 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.465749:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446011.465751:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446011.465753:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446011.568299:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446011.568345:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:0.0:1789446011.568392:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446011.568496:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722174976 00000100:00100000:3.0:1789446011.568509:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722174976 00000100:00100000:3.0:1789446011.568587:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722175232 00000100:00100000:3.0:1789446011.568590:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722175232 00000100:00100000:3.0:1789446011.568604:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722175104 00000100:00100000:3.0:1789446011.568607:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722175104 00000100:00100000:3.0:1789446011.568627:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 0 00000100:00100000:3.0:1789446011.568657:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+9:2374:x1876369722174976:12345-192.168.206.59@tcp:4:dd.0 00002000:00010000:3.0:1789446011.568720:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa8c77a, atime: 0x6aa8c779, ctime: 0x6aa8c77a, blocks: 0x1 00010000:00010000:3.0:1789446011.568731:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099e82c91/0xc1b37c4d47257758 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.568751:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1789446011.568756:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446011.568776:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099e82c91/0xc1b37c4d47257758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.568793:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099e82c91/0xc1b37c4d47257758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789446011.645004:0:15049:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1789446011.645017:0:15049:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789446010 -> 1789446011 00002000:00010000:3.0:1789446011.645022:0:15049:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1789446011.645041:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099e82c91/0xc1b37c4d47257758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.645093:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099e82c91/0xc1b37c4d47257758 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.645105:0:15049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099e82c91/0xc1b37c4d47257758 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.645114:0:15049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989c00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:3.0:1789446011.645121:0:15049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099e82c91/0xc1b37c4d47257758 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.645151:0:15049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099e82c91/0xc1b37c4d47257758 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.645176:0:15049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099e82c91/0xc1b37c4d47257758 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.645185:0:15049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099e82c91/0xc1b37c4d47257758 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446011.645303:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+11:2374:x1876369722174976:12345-192.168.206.59@tcp:4:dd.0 Request processed in 76642us (77009us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1789446011.645315:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 0 00000100:00100000:3.0:1789446011.645357:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 1 00000100:00100000:3.0:1789446011.645373:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+10:2376:x1876369722175232:12345-192.168.206.59@tcp:4:dd.0 00002000:00010000:3.0:1789446011.645422:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x6aa8c77b, atime: 0x6aa8c779, ctime: 0x0, blocks: 0x803 00010000:00010000:3.0:1789446011.645430:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbff933f/0xc1b37c4d4725775f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.645444:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1789446011.645449:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446011.645456:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbff933f/0xc1b37c4d4725775f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446011.645472:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbff933f/0xc1b37c4d4725775f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789446011.645799:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1789446011.645819:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:0.0:1789446011.694216:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:2.0:1789446011.694311:0:15049:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:2.0:1789446011.694319:0:15049:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:2.0:1789446011.694640:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbff933f/0xc1b37c4d4725775f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.694676:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbff933f/0xc1b37c4d4725775f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.694687:0:15049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbff933f/0xc1b37c4d4725775f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.694695:0:15049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afe8e989400 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789446011.694700:0:15049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbff933f/0xc1b37c4d4725775f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.694712:0:15049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbff933f/0xc1b37c4d4725775f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.694736:0:15049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbff933f/0xc1b37c4d4725775f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.694744:0:15049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbff933f/0xc1b37c4d4725775f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446011.694934:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+6:2376:x1876369722175232:12345-192.168.206.59@tcp:4:dd.0 Request processed in 49560us (126580us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789446011.694952:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 1 00000100:00100000:2.0:1789446011.694993:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 2 00000100:00100000:2.0:1789446011.695010:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+5:2374:x1876369722175104:12345-192.168.206.59@tcp:4:dd.0 00002000:00010000:2.0:1789446011.695115:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6aa8c77b, atime: 0x6aa8c779, ctime: 0x0, blocks: 0x1007 00010000:00010000:2.0:1789446011.695130:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d47257766 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.695145:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1789446011.695149:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446011.695156:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d47257766 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.695170:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d47257766 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789446011.738086:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1789446011.738224:0:15049:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1789446011.738230:0:15049:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1789446011.738249:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d47257766 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.738265:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d47257766 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.738276:0:15049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d47257766 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.738284:0:15049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f5e00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:2.0:1789446011.738289:0:15049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d47257766 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.738296:0:15049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d47257766 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.738337:0:15049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d47257766 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.738343:0:15049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d47257766 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446011.738548:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+5:2374:x1876369722175104:12345-192.168.206.59@tcp:4:dd.0 Request processed in 43535us (170145us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789446011.738560:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 2 00000100:00100000:0.0:1789446011.741806:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:3.0:1789446011.742466:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:1.0:1789446011.742552:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722175360 00000100:00100000:1.0:1789446011.742565:0:15047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722175360 00000100:00100000:1.0:1789446011.742651:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722175488 00000100:00100000:1.0:1789446011.742654:0:15047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722175488 00000100:00100000:1.0:1789446011.742678:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 3 00000100:00100000:1.0:1789446011.742774:0:15047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb5c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+6:2377:x1876369722175360:12345-192.168.206.59@tcp:4:dd.0 00002000:00010000:1.0:1789446011.742844:0:15047:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aa8c77b, atime: 0x6aa8c779, ctime: 0x0, blocks: 0x1807 00010000:00010000:1.0:1789446011.742856:0:15047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d4725776d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446011.742892:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00010000:00010000:1.0:1789446011.742894:0:15047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1789446011.742898:0:15047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446011.742906:0:15047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d4725776d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.742923:0:15047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d4725776d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446011.743244:0:15048:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789446011.743254:0:15048:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1789446011.744144:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722175616 00000100:00100000:2.0:1789446011.744152:0:15048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722175616 00000100:00100000:0.0:1789446011.747121:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 4 00000100:00100000:0.0:1789446011.747357:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+8:2377:x1876369722175488:12345-192.168.206.59@tcp:4:dd.0 00010000:00010000:0.0:1789446011.747416:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba1c3514/0xc1b37c4d47257774 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446011.747436:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1789446011.747447:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00010000:00010000:0.0:1789446011.747448:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789446011.747460:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba1c3514/0xc1b37c4d47257774 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446011.747499:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba1c3514/0xc1b37c4d47257774 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446011.747602:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.59@tcp (source: 12345-192.168.206.59@tcp) 00000100:00100000:2.0:1789446011.749646:0:15048:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789446011.749965:0:15048:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1789446011.750241:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722175744 00000100:00100000:2.0:1789446011.750256:0:15048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722175744 00000100:00100000:2.0:1789446011.750342:0:15048:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789446011.750350:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369722175872 00000100:00100000:2.0:1789446011.750353:0:15048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369722175872 00000100:00100000:2.0:1789446011.752127:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 5 00000100:00100000:2.0:1789446011.752145:0:16591:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9ee7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+11:2377:x1876369722175616:12345-192.168.206.59@tcp:4:dd.0 00010000:00010000:2.0:1789446011.752193:0:16591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d4725777b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.752215:0:16591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446011.752221:0:16591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446011.752240:0:16591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d4725777b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446011.752257:0:16591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d4725777b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789446011.797666:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:1.0:1789446011.800673:0:15047:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:1.0:1789446011.800685:0:15047:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1789446011 00002000:00010000:1.0:1789446011.800688:0:15047:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:1.0:1789446011.800706:0:15047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d4725776d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.800722:0:15047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d4725776d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.800732:0:15047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d4725776d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.800739:0:15047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c1200 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789446011.800746:0:15047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d4725776d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.800798:0:15047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d4725776d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.800826:0:15047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d4725776d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.800835:0:15047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d4725776d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446011.801262:0:15047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb5c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+15:2377:x1876369722175360:12345-192.168.206.59@tcp:4:dd.0 Request processed in 58567us (59460us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789446011.801275:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 3 00000100:00100000:1.0:1789446011.801320:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 6 00000100:00100000:1.0:1789446011.801334:0:15047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+14:2377:x1876369722175744:12345-192.168.206.59@tcp:4:dd.0 00010000:00010000:1.0:1789446011.801380:0:15047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d47257782 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.801394:0:15047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446011.801399:0:15047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446011.801407:0:15047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d47257782 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.801422:0:15047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d47257782 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789446011.847430:0:16591:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00010000:00010000:1.0:1789446011.847459:0:16591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d4725777b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.847475:0:16591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d4725777b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.847485:0:16591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d4725777b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.847492:0:16591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeba8f5e00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789446011.847498:0:16591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d4725777b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.847508:0:16591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d4725777b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.847534:0:16591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d4725777b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.847542:0:16591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064d5c88f/0xc1b37c4d4725777b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446011.847797:0:16591:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+16:2377:x1876369722175616:12345-192.168.206.59@tcp:4:dd.0 Request processed in 95650us (104897us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789446011.847830:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 5 00000100:00100000:1.0:1789446011.847889:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:1.0:1789446011.847906:0:16591:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebffc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+15:2376:x1876369722175872:12345-192.168.206.59@tcp:4:dd.0 00010000:00010000:1.0:1789446011.847948:0:16591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d47257789 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.847964:0:16591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446011.847969:0:16591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446011.847976:0:16591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d47257789 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.847990:0:16591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d47257789 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789446011.851119:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00010000:00010000:0.0:1789446011.851177:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba1c3514/0xc1b37c4d47257774 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446011.851195:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba1c3514/0xc1b37c4d47257774 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446011.851206:0:15049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba1c3514/0xc1b37c4d47257774 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446011.851214:0:15049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afeb6aacc00 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:0.0:1789446011.851220:0:15049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba1c3514/0xc1b37c4d47257774 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446011.851230:0:15049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba1c3514/0xc1b37c4d47257774 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446011.851289:0:15049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba1c3514/0xc1b37c4d47257774 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446011.851298:0:15049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba1c3514/0xc1b37c4d47257774 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446011.853537:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9ee7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+11:2377:x1876369722175488:12345-192.168.206.59@tcp:4:dd.0 Request processed in 106378us (111056us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1789446011.853554:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 4 00000001:00080000:3.0:1789446011.889808:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:1.0:1789446011.891274:0:15047:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1789446011.891286:0:15047:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1789446011.891305:0:15047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d47257782 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.891320:0:15047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d47257782 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.891329:0:15047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d47257782 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.891336:0:15047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c0600 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789446011.891361:0:15047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d47257782 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.891371:0:15047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d47257782 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.891396:0:15047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d47257782 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.891405:0:15047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083626bf0/0xc1b37c4d47257782 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446011.891525:0:15047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+9:2377:x1876369722175744:12345-192.168.206.59@tcp:4:dd.0 Request processed in 90189us (144085us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789446011.891537:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 6 00000001:00080000:0.0:1789446011.929406:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:1.0:1789446011.929828:0:16591:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1789446011.929851:0:16591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d47257789 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.929866:0:16591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d47257789 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.929877:0:16591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d47257789 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.929886:0:16591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd832c1200 already unused, calling callback (ffffffffc17998b0) 00010000:00010000:1.0:1789446011.929892:0:16591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d47257789 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.929918:0:16591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d47257789 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.929944:0:16591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d47257789 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446011.929952:0:16591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020ac6fd0/0xc1b37c4d47257789 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446011.930289:0:16591:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebffc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cd59ee15-eef8-4c7f-9b3c-4edbf6ead749+5:2376:x1876369722175872:12345-192.168.206.59@tcp:4:dd.0 Request processed in 82379us (182678us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789446011.930303:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.59@tcp, seq: 7 00000100:00100000:2.0:1789446011.994600:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742079488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789446011.994696:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789446011.994888:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446011.995021:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742079488 00000100:00100000:0.0:1789446011.995032:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742079488 00000100:00100000:0.0:1789446011.995132:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789446011.995144:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeb9f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742079488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789446011.995173:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3859808256 avail 3849322496 00000100:00100000:0.0:1789446011.995231:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeb9f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876369742079488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446011.995239:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789446011.996532:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1789446011.996543:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afd81215880, transno 8589934595 00000004:00080000:2.0:1789446011.996565:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1789446011.996601:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876369742079488:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789446013.018677:0:15680:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789446013.402015:0:16629:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1789446013.530330:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afe8a304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742079616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789446013.530434:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446013.532510:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742079616 00000100:00100000:0.0:1789446013.532533:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742079616 00000100:00100000:0.0:1789446013.532634:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789446013.532648:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afeba5cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742079616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789446013.532720:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789446013.532862:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afeba5cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876369742079616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 216us (2426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446013.532870:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789446013.532912:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789446013.532973:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afe8a304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876369742079616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789446013.535175:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c012be7-6701-48ad-95ae-ff4709bfdc58:3310:1876369742079744:0@lo:400:kworker.0 00000100:00100000:3.0:1789446013.535263:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446013.535304:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369742080256:0@lo:400:kworker.0 00000100:00100000:3.0:1789446013.535331:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446013.535357:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789446013.535363:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742079872:0@lo:400:kworker.0 00000100:00100000:3.0:1789446013.535387:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446013.535415:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742080000:0@lo:400:kworker.0 00000100:00100000:3.0:1789446013.535439:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446013.535458:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789446013.535463:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9afebf614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742080128:0@lo:400:kworker.0 00000100:00100000:3.0:1789446013.535483:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446013.535510:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742080256 00000100:00100000:3.0:1789446013.535519:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742080256 00000100:00100000:3.0:1789446013.535586:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742080000 00000100:00100000:3.0:1789446013.535589:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742080000 00000100:00100000:3.0:1789446013.535602:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742080128 00000100:00100000:3.0:1789446013.535604:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742080128 00000100:00100000:3.0:1789446013.535621:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789446013.535649:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876369742080256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446013.535708:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876369742080256:12345-0@lo:400:kworker.0 Request processed in 60us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446013.535715:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789446013.535735:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789446013.535740:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742080000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446013.535784:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876369742080000:12345-0@lo:400:kworker.0 Request processed in 44us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446013.535790:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789446013.535802:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789446013.535808:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742080128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446013.535834:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876369742080128:12345-0@lo:400:kworker.0 Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446013.535840:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789446013.535882:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876369742080128:0@lo:400:kworker.0 00000100:00100000:3.0:1789446013.535893:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876369742080000:0@lo:400:kworker.0 00000100:00100000:3.0:1789446013.535922:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876369742080256:0@lo:400:kworker.0 00000100:00100000:2.0:1789446013.538097:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742079744 00000100:00100000:2.0:1789446013.538118:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742079744 00000100:00100000:2.0:1789446013.538179:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789446013.538191:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afe9f97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:3310:x1876369742079744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446013.538302:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afe9f97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c012be7-6701-48ad-95ae-ff4709bfdc58+19:3310:x1876369742079744:12345-0@lo:400:kworker.0 Request processed in 114us (3039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446013.538310:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789446013.538356:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369742079872 00000100:00100000:2.0:1789446013.538360:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369742079872 00000100:00100000:2.0:1789446013.538394:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789446013.538401:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9afebf615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742079872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446013.538438:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9afebf615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876369742079872:12345-0@lo:400:kworker.0 Request processed in 38us (3051us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446013.538458:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789446013.538561:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876369742079872:0@lo:400:kworker.0 00000100:00100000:2.0:1789446013.538576:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9afebf615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c012be7-6701-48ad-95ae-ff4709bfdc58:3310:1876369742079744:0@lo:400:kworker.0 00000100:00080000:0.0:1789446013.541230:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789446013.541246:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789446014.042941:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789446014.555458:0:14391:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789446014.555471:0:14391:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789446014.555504:0:14391:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789446014.555510:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 Debug log: 29321 lines, 29321 kept, 0 dropped, 0 bad.